Oct 26 16:49:51 user nova-compute[75113]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75113) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75113) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75113) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 16:49:51 user nova-compute[75113]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:49:51 user nova-compute[75113]: INFO nova.virt.driver [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 26 16:49:51 user nova-compute[75113]: INFO nova.compute.provider_config [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] Acquiring lock "singleton_lock" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] Acquired lock "singleton_lock" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] Releasing lock "singleton_lock" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] Full set of CONF: {{(pid=75113) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ******************************************************************************** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] Configuration options gathered from: {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ================================================================================ {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] allow_resize_to_same_host      = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] arq_binding_timeout            = 300 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] backdoor_port                  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] backdoor_socket                = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] block_device_allocate_retries  = 300 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] block_device_allocate_retries_interval = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cert                           = self.pem {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute_monitors               = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] config_dir                     = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] config_drive_format            = iso9660 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] config_source                  = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] console_host                   = user {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] control_exchange               = nova {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cpu_allocation_ratio           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] daemon                         = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] debug                          = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] default_access_ip_network_name = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] default_availability_zone      = nova {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] default_ephemeral_format       = ext4 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] default_green_pool_size        = 1000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] default_schedule_zone          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] disk_allocation_ratio          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] enable_new_services            = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] enabled_ssl_apis               = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] flat_injected                  = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] force_config_drive             = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] force_raw_images               = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] graceful_shutdown_timeout      = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] heal_instance_info_cache_interval = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] host                           = user {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] instance_build_timeout         = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] instance_delete_interval       = 300 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] instance_name_template         = instance-%08x {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] instance_usage_audit           = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] instance_usage_audit_period    = month {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] internal_service_availability_zone = internal {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] key                            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] live_migration_retry_count     = 30 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] log_config_append              = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] log_dir                        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] log_file                       = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] log_options                    = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] log_rotate_interval            = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] log_rotate_interval_type       = days {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] log_rotation_type              = none {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] long_rpc_timeout               = 1800 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] max_concurrent_builds          = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] max_concurrent_live_migrations = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] max_concurrent_snapshots       = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] max_local_block_devices        = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] max_logfile_count              = 30 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] max_logfile_size_mb            = 200 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] maximum_instance_delete_attempts = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] metadata_listen                = 0.0.0.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] metadata_listen_port           = 8775 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] metadata_workers               = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] migrate_max_retries            = -1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] mkisofs_cmd                    = genisoimage {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] my_ip                          = 10.0.0.210 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] network_allocate_retries       = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] osapi_compute_listen_port      = 8774 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] osapi_compute_unique_server_name_scope =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] osapi_compute_workers          = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] password_length                = 12 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] periodic_enable                = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] periodic_fuzzy_delay           = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] pointer_model                  = ps2mouse {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] preallocate_images             = none {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] publish_errors                 = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] pybasedir                      = /opt/stack/nova {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ram_allocation_ratio           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] rate_limit_burst               = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] rate_limit_except_level        = CRITICAL {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] rate_limit_interval            = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] reboot_timeout                 = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] reclaim_instance_interval      = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] record                         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] reimage_timeout_per_gb         = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] report_interval                = 120 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] rescue_timeout                 = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] reserved_host_cpus             = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] reserved_host_disk_mb          = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] reserved_host_memory_mb        = 512 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] reserved_huge_pages            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] resize_confirm_window          = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] resize_fs_using_block_device   = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] resume_guests_state_on_host_boot = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] rpc_response_timeout           = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] run_external_periodic_tasks    = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] running_deleted_instance_action = reap {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] running_deleted_instance_timeout = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] scheduler_instance_sync_interval = 120 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] service_down_time              = 720 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] servicegroup_driver            = db {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] shelved_offload_time           = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] shelved_poll_interval          = 3600 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] shutdown_timeout               = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] source_is_ipv6                 = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ssl_only                       = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] state_path                     = /opt/stack/data/nova {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] sync_power_state_interval      = 600 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] sync_power_state_pool_size     = 1000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] syslog_log_facility            = LOG_USER {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] tempdir                        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] timeout_nbd                    = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] transport_url                  = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] update_resources_interval      = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] use_cow_images                 = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] use_eventlog                   = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] use_journal                    = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] use_json                       = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] use_rootwrap_daemon            = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] use_stderr                     = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] use_syslog                     = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vcpu_pin_set                   = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plugging_is_fatal          = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plugging_timeout           = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] virt_mkfs                      = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] volume_usage_poll_interval     = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] watch_log_file                 = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] web                            = /usr/share/spice-html5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_concurrency.disable_process_locking = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.auth_strategy              = keystone {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.compute_link_prefix        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.dhcp_domain                = novalocal {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.enable_instance_password   = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.glance_link_prefix         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.instance_list_per_project_cells = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.list_records_by_skipping_down_cells = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.local_metadata_per_cell    = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.max_limit                  = 1000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.metadata_cache_expiration  = 15 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.neutron_default_tenant_id  = default {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.use_forwarded_for          = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.use_neutron_default_nets   = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.vendordata_dynamic_targets = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.vendordata_jsonfile_path   = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.backend_argument         = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.config_prefix            = cache.oslo {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.dead_timeout             = 60.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.debug_cache_backend      = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.enable_retry_client      = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.enable_socket_keepalive  = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.enabled                  = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.expiration_time          = 600 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.hashclient_retry_attempts = 2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.memcache_dead_retry      = 300 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.memcache_password        =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.memcache_sasl_enabled    = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.memcache_username        =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.proxies                  = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.retry_attempts           = 2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.retry_delay              = 0.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.socket_keepalive_count   = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.socket_keepalive_idle    = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.socket_keepalive_interval = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.tls_allowed_ciphers      = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.tls_cafile               = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.tls_certfile             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.tls_enabled              = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cache.tls_keyfile              = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.auth_section            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.auth_type               = password {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.cafile                  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.certfile                = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.collect_timing          = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.cross_az_attach         = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.debug                   = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.endpoint_template       = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.http_retries            = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.insecure                = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.keyfile                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.os_region_name          = RegionOne {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.split_loggers           = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cinder.timeout                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute.cpu_dedicated_set      = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute.cpu_shared_set         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute.image_type_exclude_list = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute.resource_provider_association_refresh = 300 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute.shutdown_retry_interval = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] conductor.workers              = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] console.allowed_origins        = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] console.ssl_ciphers            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] console.ssl_minimum_version    = default {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] consoleauth.token_ttl          = 600 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.cafile                  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.certfile                = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.collect_timing          = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.connect_retries         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.connect_retry_delay     = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.endpoint_override       = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.insecure                = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.keyfile                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.max_version             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.min_version             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.region_name             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.service_name            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.service_type            = accelerator {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.split_loggers           = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.status_code_retries     = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.status_code_retry_delay = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.timeout                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] cyborg.version                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.backend               = sqlalchemy {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.connection            = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.connection_debug      = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.connection_parameters =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.connection_recycle_time = 3600 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.connection_trace      = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.db_inc_retry_interval = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.db_max_retries        = 20 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.db_max_retry_interval = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.db_retry_interval     = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.max_overflow          = 50 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.max_pool_size         = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.max_retries           = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.mysql_wsrep_sync_wait = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.pool_timeout          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.retry_interval        = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.slave_connection      = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] database.sqlite_synchronous    = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.backend           = sqlalchemy {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.connection        = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.connection_debug  = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.connection_parameters =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.connection_recycle_time = 3600 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.connection_trace  = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.db_inc_retry_interval = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.db_max_retries    = 20 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.db_max_retry_interval = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.db_retry_interval = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.max_overflow      = 50 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.max_pool_size     = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.max_retries       = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.pool_timeout      = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.retry_interval    = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.slave_connection  = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] api_database.sqlite_synchronous = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] devices.enabled_mdev_types     = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ephemeral_storage_encryption.enabled = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.api_servers             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.cafile                  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.certfile                = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.collect_timing          = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.connect_retries         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.connect_retry_delay     = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.debug                   = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.default_trusted_certificate_ids = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.enable_certificate_validation = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.enable_rbd_download     = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.endpoint_override       = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.insecure                = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.keyfile                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.max_version             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.min_version             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.num_retries             = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.rbd_ceph_conf           =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.rbd_connect_timeout     = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.rbd_pool                =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.rbd_user                =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.region_name             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.service_name            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.service_type            = image {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.split_loggers           = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.status_code_retries     = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.status_code_retry_delay = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.timeout                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.verify_glance_signatures = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] glance.version                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] guestfs.debug                  = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.config_drive_cdrom      = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.config_drive_inject_password = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.enable_remotefx         = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.instances_path_share    =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.limit_cpu_features      = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.use_multipath_io        = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.vswitch_name            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] mks.enabled                    = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] image_cache.manager_interval   = 2400 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] image_cache.precache_concurrency = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] image_cache.remove_unused_base_images = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] image_cache.subdirectory_name  = _base {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.api_max_retries         = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.api_retry_interval      = 2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.auth_section            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.auth_type               = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.cafile                  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.certfile                = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.collect_timing          = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.conductor_group         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.connect_retries         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.connect_retry_delay     = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.endpoint_override       = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.insecure                = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.keyfile                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.max_version             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.min_version             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.peer_list               = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.region_name             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.serial_console_state_timeout = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.service_name            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.service_type            = baremetal {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.split_loggers           = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.status_code_retries     = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.status_code_retry_delay = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.timeout                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ironic.version                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] key_manager.fixed_key          = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.barbican_api_version  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.barbican_endpoint     = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.barbican_endpoint_type = public {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.barbican_region_name  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.cafile                = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.certfile              = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.collect_timing        = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.insecure              = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.keyfile               = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.number_of_retries     = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.retry_delay           = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.send_service_user_token = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.split_loggers         = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.timeout               = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.verify_ssl            = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican.verify_ssl_path       = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican_service_user.auth_section = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican_service_user.auth_type = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican_service_user.cafile   = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican_service_user.certfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican_service_user.collect_timing = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican_service_user.insecure = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican_service_user.keyfile  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican_service_user.split_loggers = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] barbican_service_user.timeout  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.approle_role_id          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.approle_secret_id        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.cafile                   = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.certfile                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.collect_timing           = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.insecure                 = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.keyfile                  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.kv_mountpoint            = secret {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.kv_path                  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.kv_version               = 2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.namespace                = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.root_token_id            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.split_loggers            = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.ssl_ca_crt_file          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.timeout                  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.use_ssl                  = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.auth_section          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.auth_type             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.cafile                = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.certfile              = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.collect_timing        = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.connect_retries       = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.connect_retry_delay   = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.endpoint_override     = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.insecure              = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.keyfile               = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.max_version           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.min_version           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.region_name           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.service_name          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.service_type          = identity {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.split_loggers         = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.status_code_retries   = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.status_code_retry_delay = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.timeout               = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] keystone.version               = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.connection_uri         =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.cpu_mode               = custom {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: WARNING oslo_config.cfg [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.cpu_power_governor_high = performance {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.cpu_power_management   = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.device_detach_attempts = 8 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.device_detach_timeout  = 20 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.disk_cachemodes        = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.disk_prefix            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.enabled_perf_events    = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.file_backed_memory     = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.gid_maps               = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.hw_disk_discard        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.hw_machine_type        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.images_rbd_pool        = rbd {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.images_type            = default {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.images_volume_group    = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.inject_key             = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.inject_partition       = -2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.inject_password        = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.iscsi_iface            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.iser_use_multipath     = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.live_migration_downtime = 500 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.live_migration_inbound_addr = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.live_migration_scheme  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.live_migration_timeout_action = abort {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.live_migration_tunnelled = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: WARNING oslo_config.cfg [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 26 16:49:51 user nova-compute[75113]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 26 16:49:51 user nova-compute[75113]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 26 16:49:51 user nova-compute[75113]: and ``live_migration_inbound_addr`` respectively.
Oct 26 16:49:51 user nova-compute[75113]: ).  Its value may be silently ignored in the future.
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.live_migration_with_native_tls = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.max_queues             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.nfs_mount_options      = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.num_pcie_ports         = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.pmem_namespaces        = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.quobyte_client_cfg     = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.rbd_secret_uuid        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.rbd_user               = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.rescue_image_id        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.rescue_kernel_id       = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.rx_queue_size          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.smbfs_mount_options    =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.snapshot_compression   = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.snapshot_image_format  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.sparse_logical_volumes = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.swtpm_enabled          = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.swtpm_group            = tss {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.swtpm_user             = tss {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.sysinfo_serial         = unique {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.tb_cache_size          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.tx_queue_size          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.uid_maps               = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.use_virtio_for_bridges = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.virt_type              = kvm {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.volume_clear           = zero {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.volume_clear_size      = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.volume_use_multipath   = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.vzstorage_cache_path   = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.auth_section           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.auth_type              = password {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.cafile                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.certfile               = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.collect_timing         = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.connect_retries        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.connect_retry_delay    = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.default_floating_pool  = public {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.endpoint_override      = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.extension_sync_interval = 600 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.http_retries           = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.insecure               = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.keyfile                = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.max_version            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.min_version            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.ovs_bridge             = br-int {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.physnets               = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.region_name            = RegionOne {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.service_metadata_proxy = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.service_name           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.service_type           = network {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.split_loggers          = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.status_code_retries    = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.status_code_retry_delay = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.timeout                = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] neutron.version                = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] notifications.bdms_in_notifications = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] notifications.default_level    = INFO {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] notifications.notification_format = unversioned {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] notifications.notify_on_state_change = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] pci.alias                      = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] pci.device_spec                = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] pci.report_in_placement        = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.auth_section         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.auth_type            = password {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.cafile               = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.certfile             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.collect_timing       = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.connect_retries      = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.connect_retry_delay  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.default_domain_id    = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.default_domain_name  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.domain_id            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.domain_name          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.endpoint_override    = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.insecure             = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.keyfile              = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.max_version          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.min_version          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.password             = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.project_domain_id    = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.project_domain_name  = Default {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.project_id           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.project_name         = service {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.region_name          = RegionOne {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.service_name         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.service_type         = placement {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.split_loggers        = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.status_code_retries  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.status_code_retry_delay = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.system_scope         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.timeout              = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.trust_id             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.user_domain_id       = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.user_domain_name     = Default {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.user_id              = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.username             = placement {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] placement.version              = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] quota.cores                    = 20 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] quota.count_usage_from_placement = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] quota.injected_file_content_bytes = 10240 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] quota.injected_file_path_length = 255 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] quota.injected_files           = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] quota.instances                = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] quota.key_pairs                = 100 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] quota.metadata_items           = 128 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] quota.ram                      = 51200 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] quota.recheck_quota            = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] quota.server_group_members     = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] quota.server_groups            = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] rdp.enabled                    = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] scheduler.image_metadata_prefilter = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] scheduler.max_attempts         = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] scheduler.max_placement_results = 1000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] scheduler.workers              = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.host_subset_size = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.isolated_hosts = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.isolated_images = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.pci_in_placement = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.track_instance_changes = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] metrics.required               = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] metrics.weight_multiplier      = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] metrics.weight_setting         = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] serial_console.enabled         = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] serial_console.port_range      = 10000:20000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] serial_console.serialproxy_port = 6083 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] service_user.auth_section      = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] service_user.auth_type         = password {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] service_user.cafile            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] service_user.certfile          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] service_user.collect_timing    = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] service_user.insecure          = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] service_user.keyfile           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] service_user.send_service_user_token = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] service_user.split_loggers     = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] service_user.timeout           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] spice.agent_enabled            = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] spice.enabled                  = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] spice.html5proxy_port          = 6082 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] spice.image_compression        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] spice.jpeg_compression         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] spice.playback_compression     = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] spice.server_listen            = 127.0.0.1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] spice.streaming_mode           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] spice.zlib_compression         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] upgrade_levels.baseapi         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] upgrade_levels.cert            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] upgrade_levels.compute         = auto {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] upgrade_levels.conductor       = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] upgrade_levels.scheduler       = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vendordata_dynamic_auth.cafile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vendordata_dynamic_auth.certfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vendordata_dynamic_auth.insecure = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vendordata_dynamic_auth.timeout = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.api_retry_count         = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.ca_file                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.cache_prefix            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.cluster_name            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.connection_pool_size    = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.console_delay_seconds   = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.datastore_regex         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.host_ip                 = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.host_password           = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.host_port               = 443 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.host_username           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.insecure                = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.integration_bridge      = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.maximum_objects         = 100 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.pbm_default_policy      = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.pbm_enabled             = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.pbm_wsdl_location       = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.serial_port_proxy_uri   = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.serial_port_service_uri = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.task_poll_interval      = 0.5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.use_linked_clone        = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.vnc_keymap              = en-us {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.vnc_port                = 5900 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vmware.vnc_port_total          = 10000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vnc.auth_schemes               = ['none'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vnc.enabled                    = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vnc.novncproxy_port            = 6080 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vnc.vencrypt_ca_certs          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vnc.vencrypt_client_cert       = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vnc.vencrypt_client_key        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.disable_rootwrap   = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.enable_numa_live_migration = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.libvirt_disable_apic = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] wsgi.client_socket_timeout     = 900 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] wsgi.default_pool_size         = 1000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] wsgi.keep_alive                = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] wsgi.max_header_line           = 16384 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] wsgi.ssl_ca_file               = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] wsgi.ssl_cert_file             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] wsgi.ssl_key_file              = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] wsgi.tcp_keepidle              = 600 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] zvm.ca_file                    = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] zvm.cloud_connector_url        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] zvm.reachable_timeout          = 300 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_policy.enforce_new_defaults = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_policy.enforce_scope      = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_policy.policy_default_rule = default {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler.connection_string     = messaging:// {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler.enabled               = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler.es_doc_type           = notification {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler.es_scroll_size        = 10000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler.es_scroll_time        = 2m {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler.filter_error_trace    = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler.hmac_keys             = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler.sentinel_service_name = mymaster {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler.socket_timeout        = 0.1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler.trace_requests        = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler.trace_sqlalchemy      = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler_jaeger.process_tags   = {} {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler_jaeger.service_name_prefix = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] profiler_otlp.service_name_prefix = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] remote_debug.host              = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] remote_debug.port              = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_notifications.retry = -1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.auth_section        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.auth_type           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.cafile              = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.certfile            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.collect_timing      = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.connect_retries     = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.connect_retry_delay = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.endpoint_id         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.endpoint_override   = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.insecure            = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.keyfile             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.max_version         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.min_version         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.region_name         = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.service_name        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.service_type        = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.split_loggers       = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.status_code_retries = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.status_code_retry_delay = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.timeout             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.valid_interfaces    = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_limit.version             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_reports.file_event_handler = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] oslo_reports.log_dir           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plug_ovs_privileged.group  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] vif_plug_ovs_privileged.user   = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_ovs.isolate_vif         = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] os_brick.lock_path             = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] privsep_osbrick.capabilities   = [21] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] privsep_osbrick.group          = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] privsep_osbrick.helper_command = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] privsep_osbrick.user           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] nova_sys_admin.group           = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] nova_sys_admin.helper_command  = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] nova_sys_admin.user            = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 16:49:51 user nova-compute[75113]: DEBUG oslo_service.service [None req-cea2b600-bfd2-40b1-846d-82af4c082e22 None None] ******************************************************************************** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 26 16:49:51 user nova-compute[75113]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 26 16:49:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Connecting to libvirt: qemu:///system {{(pid=75113) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 26 16:49:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4934d76530> {{(pid=75113) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 26 16:49:52 user nova-compute[75113]: libvirt:  error : internal error: could not initialize domain event timer
Oct 26 16:49:52 user nova-compute[75113]: WARNING nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 26 16:49:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4934d76530> {{(pid=75113) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 26 16:49:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Starting native event thread {{(pid=75113) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 26 16:49:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Starting green dispatch thread {{(pid=75113) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 26 16:49:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Starting connection event dispatch thread {{(pid=75113) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 26 16:49:52 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Connection event '1' reason 'None'
Oct 26 16:49:52 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 26 16:49:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.mount [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Initialising _HostMountState generation 0 {{(pid=75113) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 26 16:49:59 user nova-compute[75113]: INFO nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Libvirt host capabilities <capabilities>
Oct 26 16:49:59 user nova-compute[75113]:   <host>
Oct 26 16:49:59 user nova-compute[75113]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 26 16:49:59 user nova-compute[75113]:     <cpu>
Oct 26 16:49:59 user nova-compute[75113]:       <arch>x86_64</arch>
Oct 26 16:49:59 user nova-compute[75113]:       <model>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <vendor>Intel</vendor>
Oct 26 16:49:59 user nova-compute[75113]:       <microcode version='1070'/>
Oct 26 16:49:59 user nova-compute[75113]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 26 16:49:59 user nova-compute[75113]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='ss'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='vmx'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='pcid'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='osxsave'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='hypervisor'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='arat'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='tsc_adjust'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='md-clear'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='arch-capabilities'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='invtsc'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='rsba'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature name='skip-l1dfl-vmentry'/>
Oct 26 16:49:59 user nova-compute[75113]:       <pages unit='KiB' size='4'/>
Oct 26 16:49:59 user nova-compute[75113]:       <pages unit='KiB' size='2048'/>
Oct 26 16:49:59 user nova-compute[75113]:     </cpu>
Oct 26 16:49:59 user nova-compute[75113]:     <power_management>
Oct 26 16:49:59 user nova-compute[75113]:       <suspend_mem/>
Oct 26 16:49:59 user nova-compute[75113]:       <suspend_disk/>
Oct 26 16:49:59 user nova-compute[75113]:       <suspend_hybrid/>
Oct 26 16:49:59 user nova-compute[75113]:     </power_management>
Oct 26 16:49:59 user nova-compute[75113]:     <iommu support='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     <migration_features>
Oct 26 16:49:59 user nova-compute[75113]:       <live/>
Oct 26 16:49:59 user nova-compute[75113]:       <uri_transports>
Oct 26 16:49:59 user nova-compute[75113]:         <uri_transport>tcp</uri_transport>
Oct 26 16:49:59 user nova-compute[75113]:         <uri_transport>rdma</uri_transport>
Oct 26 16:49:59 user nova-compute[75113]:       </uri_transports>
Oct 26 16:49:59 user nova-compute[75113]:     </migration_features>
Oct 26 16:49:59 user nova-compute[75113]:     <topology>
Oct 26 16:49:59 user nova-compute[75113]:       <cells num='2'>
Oct 26 16:49:59 user nova-compute[75113]:         <cell id='0'>
Oct 26 16:49:59 user nova-compute[75113]:           <memory unit='KiB'>8140616</memory>
Oct 26 16:49:59 user nova-compute[75113]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 26 16:49:59 user nova-compute[75113]:           <pages unit='KiB' size='2048'>0</pages>
Oct 26 16:49:59 user nova-compute[75113]:           <distances>
Oct 26 16:49:59 user nova-compute[75113]:             <sibling id='0' value='10'/>
Oct 26 16:49:59 user nova-compute[75113]:             <sibling id='1' value='20'/>
Oct 26 16:49:59 user nova-compute[75113]:           </distances>
Oct 26 16:49:59 user nova-compute[75113]:           <cpus num='6'>
Oct 26 16:49:59 user nova-compute[75113]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 26 16:49:59 user nova-compute[75113]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 26 16:49:59 user nova-compute[75113]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 26 16:49:59 user nova-compute[75113]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 26 16:49:59 user nova-compute[75113]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 26 16:49:59 user nova-compute[75113]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 26 16:49:59 user nova-compute[75113]:           </cpus>
Oct 26 16:49:59 user nova-compute[75113]:         </cell>
Oct 26 16:49:59 user nova-compute[75113]:         <cell id='1'>
Oct 26 16:49:59 user nova-compute[75113]:           <memory unit='KiB'>8255068</memory>
Oct 26 16:49:59 user nova-compute[75113]:           <pages unit='KiB' size='4'>2063767</pages>
Oct 26 16:49:59 user nova-compute[75113]:           <pages unit='KiB' size='2048'>0</pages>
Oct 26 16:49:59 user nova-compute[75113]:           <distances>
Oct 26 16:49:59 user nova-compute[75113]:             <sibling id='0' value='20'/>
Oct 26 16:49:59 user nova-compute[75113]:             <sibling id='1' value='10'/>
Oct 26 16:49:59 user nova-compute[75113]:           </distances>
Oct 26 16:49:59 user nova-compute[75113]:           <cpus num='6'>
Oct 26 16:49:59 user nova-compute[75113]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 26 16:49:59 user nova-compute[75113]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 26 16:49:59 user nova-compute[75113]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 26 16:49:59 user nova-compute[75113]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 26 16:49:59 user nova-compute[75113]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 26 16:49:59 user nova-compute[75113]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 26 16:49:59 user nova-compute[75113]:           </cpus>
Oct 26 16:49:59 user nova-compute[75113]:         </cell>
Oct 26 16:49:59 user nova-compute[75113]:       </cells>
Oct 26 16:49:59 user nova-compute[75113]:     </topology>
Oct 26 16:49:59 user nova-compute[75113]:     <cache>
Oct 26 16:49:59 user nova-compute[75113]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 26 16:49:59 user nova-compute[75113]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 26 16:49:59 user nova-compute[75113]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 26 16:49:59 user nova-compute[75113]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 26 16:49:59 user nova-compute[75113]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 26 16:49:59 user nova-compute[75113]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 26 16:49:59 user nova-compute[75113]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 26 16:49:59 user nova-compute[75113]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 26 16:49:59 user nova-compute[75113]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 26 16:49:59 user nova-compute[75113]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 26 16:49:59 user nova-compute[75113]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 26 16:49:59 user nova-compute[75113]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 26 16:49:59 user nova-compute[75113]:     </cache>
Oct 26 16:49:59 user nova-compute[75113]:     <secmodel>
Oct 26 16:49:59 user nova-compute[75113]:       <model>apparmor</model>
Oct 26 16:49:59 user nova-compute[75113]:       <doi>0</doi>
Oct 26 16:49:59 user nova-compute[75113]:     </secmodel>
Oct 26 16:49:59 user nova-compute[75113]:     <secmodel>
Oct 26 16:49:59 user nova-compute[75113]:       <model>dac</model>
Oct 26 16:49:59 user nova-compute[75113]:       <doi>0</doi>
Oct 26 16:49:59 user nova-compute[75113]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 26 16:49:59 user nova-compute[75113]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 26 16:49:59 user nova-compute[75113]:     </secmodel>
Oct 26 16:49:59 user nova-compute[75113]:   </host>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='alpha'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>64</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>clipper</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='armv6l'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>spitz</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>nuri</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>kzm</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sx1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>z2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>tosa</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>n810</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>n800</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>terrier</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>midway</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>microbit</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>verdex</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>highbank</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>akita</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>connex</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>collie</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='armv7l'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>spitz</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>nuri</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>kzm</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sx1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>z2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>tosa</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>n810</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>n800</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>terrier</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>midway</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>microbit</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>verdex</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>highbank</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>akita</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>connex</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>collie</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='aarch64'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>64</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>spitz</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>nuri</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>kzm</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sx1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>z2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>tosa</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>n810</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>n800</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>terrier</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>midway</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>microbit</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>verdex</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>raspi3b</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>highbank</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>akita</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>connex</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>collie</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <acpi default='on' toggle='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='cris'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='i686'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>x-remote</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>isapc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>microvm</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='kvm'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <pae/>
Oct 26 16:49:59 user nova-compute[75113]:       <nonpae/>
Oct 26 16:49:59 user nova-compute[75113]:       <acpi default='on' toggle='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:       <apic default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='m68k'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>an5206</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>q800</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>next-cube</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='microblaze'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='microblazeel'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='mips'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='16'>malta</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='mipsel'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='16'>malta</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='mips64'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>64</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='16'>malta</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>pica61</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>magnum</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='mips64el'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>64</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='16'>malta</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>pica61</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>magnum</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='16'>boston</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='ppc'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mac99</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>40p</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>taihu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='ppc64'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>64</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2048'>powernv9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>taihu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2048'>powernv10</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>40p</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mac99</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2048'>powernv8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='ppc64le'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>64</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2048'>powernv9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>taihu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2048'>powernv10</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>40p</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>mac99</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2048'>powernv8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='riscv32'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='8'>spike</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>opentitan</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='5'>sifive_u</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sifive_e</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='8'>virt</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='riscv64'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>64</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='8'>spike</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='5'>sifive_u</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>shakti_c</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sifive_e</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='8'>virt</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='s390x'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>64</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='sh4'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>shix</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>r2d</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='sh4eb'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>64</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>shix</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>r2d</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='sparc'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>SS-5</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>SS-20</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>LX</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>SS-4</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>SS-10</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>Voyager</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='sparc64'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>64</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sun4u</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>niagara</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>sun4v</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='x86_64'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>64</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>x-remote</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='1'>isapc</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>microvm</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='kvm'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <acpi default='on' toggle='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:       <apic default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='xtensa'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>sim</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>kc705</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>ml605</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>virt</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>lx200</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>lx60</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]:   <guest>
Oct 26 16:49:59 user nova-compute[75113]:     <os_type>hvm</os_type>
Oct 26 16:49:59 user nova-compute[75113]:     <arch name='xtensaeb'>
Oct 26 16:49:59 user nova-compute[75113]:       <wordsize>32</wordsize>
Oct 26 16:49:59 user nova-compute[75113]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='4'>sim</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>kc705</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>ml605</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>virt</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>lx200</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>lx60</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 26 16:49:59 user nova-compute[75113]:       <domain type='qemu'/>
Oct 26 16:49:59 user nova-compute[75113]:     </arch>
Oct 26 16:49:59 user nova-compute[75113]:     <features>
Oct 26 16:49:59 user nova-compute[75113]:       <cpuselection/>
Oct 26 16:49:59 user nova-compute[75113]:       <deviceboot/>
Oct 26 16:49:59 user nova-compute[75113]:       <disksnapshot default='on' toggle='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     </features>
Oct 26 16:49:59 user nova-compute[75113]:   </guest>
Oct 26 16:49:59 user nova-compute[75113]: </capabilities>
Oct 26 16:49:59 user nova-compute[75113]: 
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 26 16:49:59 user nova-compute[75113]: <domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 16:49:59 user nova-compute[75113]:   <domain>kvm</domain>
Oct 26 16:49:59 user nova-compute[75113]:   <machine>pc-q35-jammy</machine>
Oct 26 16:49:59 user nova-compute[75113]:   <arch>i686</arch>
Oct 26 16:49:59 user nova-compute[75113]:   <vcpu max='288'/>
Oct 26 16:49:59 user nova-compute[75113]:   <iothreads supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:   <os supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='firmware'/>
Oct 26 16:49:59 user nova-compute[75113]:     <loader supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>rom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pflash</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='readonly'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>yes</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='secure'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </loader>
Oct 26 16:49:59 user nova-compute[75113]:   </os>
Oct 26 16:49:59 user nova-compute[75113]:   <cpu>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-passthrough' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='hostPassthroughMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='maximum' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='maximumMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>on</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-model' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <vendor>Intel</vendor>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ss'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='vmx'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='pcid'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='hypervisor'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arat'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='umip'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='md-clear'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibpb'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibrs'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='erms'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='lm'/>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='custom' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>qemu64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>qemu32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>phenom</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>n270</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>kvm64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>kvm32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>coreduo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>core2duo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>athlon</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Westmere</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Snowridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Penryn</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G5</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G4</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G1</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Nehalem</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Rome</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Milan</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Dhyana</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cooperlake</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Conroe</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>486</model>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:   </cpu>
Oct 26 16:49:59 user nova-compute[75113]:   <memoryBacking supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='sourceType'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>file</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>anonymous</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>memfd</value>
Oct 26 16:49:59 user nova-compute[75113]:     </enum>
Oct 26 16:49:59 user nova-compute[75113]:   </memoryBacking>
Oct 26 16:49:59 user nova-compute[75113]:   <devices>
Oct 26 16:49:59 user nova-compute[75113]:     <disk supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='diskDevice'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>disk</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cdrom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>floppy</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>lun</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='bus'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>fdc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sata</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </disk>
Oct 26 16:49:59 user nova-compute[75113]:     <graphics supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sdl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vnc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>spice</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egl-headless</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </graphics>
Oct 26 16:49:59 user nova-compute[75113]:     <video supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='modelType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cirrus</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vmvga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>qxl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>none</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>bochs</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>ramfb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </video>
Oct 26 16:49:59 user nova-compute[75113]:     <hostdev supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='mode'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>subsystem</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='startupPolicy'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>default</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>mandatory</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>requisite</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>optional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='subsysType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pci</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='capsType'/>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='pciBackend'/>
Oct 26 16:49:59 user nova-compute[75113]:     </hostdev>
Oct 26 16:49:59 user nova-compute[75113]:     <rng supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>random</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egd</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>builtin</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </rng>
Oct 26 16:49:59 user nova-compute[75113]:     <filesystem supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='driverType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>path</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>handle</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtiofs</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </filesystem>
Oct 26 16:49:59 user nova-compute[75113]:     <tpm supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-tis</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-crb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>passthrough</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>emulator</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </tpm>
Oct 26 16:49:59 user nova-compute[75113]:   </devices>
Oct 26 16:49:59 user nova-compute[75113]:   <features>
Oct 26 16:49:59 user nova-compute[75113]:     <gic supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     <vmcoreinfo supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <genid supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backingStoreInput supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backup supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <sev supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:   </features>
Oct 26 16:49:59 user nova-compute[75113]: </domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:  {{(pid=75113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 26 16:49:59 user nova-compute[75113]: <domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 16:49:59 user nova-compute[75113]:   <domain>kvm</domain>
Oct 26 16:49:59 user nova-compute[75113]:   <machine>pc-i440fx-jammy</machine>
Oct 26 16:49:59 user nova-compute[75113]:   <arch>i686</arch>
Oct 26 16:49:59 user nova-compute[75113]:   <vcpu max='255'/>
Oct 26 16:49:59 user nova-compute[75113]:   <iothreads supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:   <os supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='firmware'/>
Oct 26 16:49:59 user nova-compute[75113]:     <loader supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>rom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pflash</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='readonly'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>yes</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='secure'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </loader>
Oct 26 16:49:59 user nova-compute[75113]:   </os>
Oct 26 16:49:59 user nova-compute[75113]:   <cpu>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-passthrough' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='hostPassthroughMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='maximum' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='maximumMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>on</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-model' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <vendor>Intel</vendor>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ss'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='vmx'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='pcid'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='hypervisor'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arat'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='umip'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='md-clear'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibpb'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibrs'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='erms'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='lm'/>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='custom' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>qemu64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>qemu32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>phenom</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>n270</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>kvm64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>kvm32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>coreduo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>core2duo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>athlon</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Westmere</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Snowridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Penryn</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G5</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G4</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G1</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Nehalem</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Rome</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Milan</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Dhyana</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cooperlake</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Conroe</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>486</model>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:   </cpu>
Oct 26 16:49:59 user nova-compute[75113]:   <memoryBacking supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='sourceType'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>file</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>anonymous</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>memfd</value>
Oct 26 16:49:59 user nova-compute[75113]:     </enum>
Oct 26 16:49:59 user nova-compute[75113]:   </memoryBacking>
Oct 26 16:49:59 user nova-compute[75113]:   <devices>
Oct 26 16:49:59 user nova-compute[75113]:     <disk supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='diskDevice'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>disk</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cdrom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>floppy</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>lun</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='bus'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>ide</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>fdc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sata</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </disk>
Oct 26 16:49:59 user nova-compute[75113]:     <graphics supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sdl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vnc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>spice</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egl-headless</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </graphics>
Oct 26 16:49:59 user nova-compute[75113]:     <video supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='modelType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cirrus</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vmvga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>qxl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>none</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>bochs</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>ramfb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </video>
Oct 26 16:49:59 user nova-compute[75113]:     <hostdev supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='mode'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>subsystem</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='startupPolicy'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>default</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>mandatory</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>requisite</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>optional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='subsysType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pci</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='capsType'/>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='pciBackend'/>
Oct 26 16:49:59 user nova-compute[75113]:     </hostdev>
Oct 26 16:49:59 user nova-compute[75113]:     <rng supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>random</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egd</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>builtin</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </rng>
Oct 26 16:49:59 user nova-compute[75113]:     <filesystem supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='driverType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>path</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>handle</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtiofs</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </filesystem>
Oct 26 16:49:59 user nova-compute[75113]:     <tpm supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-tis</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-crb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>passthrough</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>emulator</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </tpm>
Oct 26 16:49:59 user nova-compute[75113]:   </devices>
Oct 26 16:49:59 user nova-compute[75113]:   <features>
Oct 26 16:49:59 user nova-compute[75113]:     <gic supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     <vmcoreinfo supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <genid supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backingStoreInput supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backup supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <sev supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:   </features>
Oct 26 16:49:59 user nova-compute[75113]: </domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:  {{(pid=75113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 26 16:49:59 user nova-compute[75113]: <domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 16:49:59 user nova-compute[75113]:   <domain>kvm</domain>
Oct 26 16:49:59 user nova-compute[75113]:   <machine>pc-q35-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:   <arch>i686</arch>
Oct 26 16:49:59 user nova-compute[75113]:   <vcpu max='288'/>
Oct 26 16:49:59 user nova-compute[75113]:   <iothreads supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:   <os supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='firmware'/>
Oct 26 16:49:59 user nova-compute[75113]:     <loader supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>rom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pflash</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='readonly'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>yes</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='secure'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </loader>
Oct 26 16:49:59 user nova-compute[75113]:   </os>
Oct 26 16:49:59 user nova-compute[75113]:   <cpu>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-passthrough' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='hostPassthroughMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='maximum' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='maximumMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>on</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-model' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <vendor>Intel</vendor>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ss'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='vmx'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='pcid'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='hypervisor'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arat'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='umip'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='md-clear'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibpb'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibrs'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='erms'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='lm'/>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='custom' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>qemu64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>qemu32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>phenom</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>n270</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>kvm64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>kvm32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>coreduo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>core2duo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>athlon</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Westmere</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Snowridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Penryn</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G5</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G4</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G1</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Nehalem</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Rome</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Milan</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Dhyana</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cooperlake</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Conroe</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>486</model>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:   </cpu>
Oct 26 16:49:59 user nova-compute[75113]:   <memoryBacking supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='sourceType'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>file</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>anonymous</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>memfd</value>
Oct 26 16:49:59 user nova-compute[75113]:     </enum>
Oct 26 16:49:59 user nova-compute[75113]:   </memoryBacking>
Oct 26 16:49:59 user nova-compute[75113]:   <devices>
Oct 26 16:49:59 user nova-compute[75113]:     <disk supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='diskDevice'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>disk</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cdrom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>floppy</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>lun</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='bus'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>fdc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sata</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </disk>
Oct 26 16:49:59 user nova-compute[75113]:     <graphics supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sdl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vnc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>spice</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egl-headless</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </graphics>
Oct 26 16:49:59 user nova-compute[75113]:     <video supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='modelType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cirrus</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vmvga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>qxl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>none</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>bochs</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>ramfb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </video>
Oct 26 16:49:59 user nova-compute[75113]:     <hostdev supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='mode'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>subsystem</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='startupPolicy'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>default</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>mandatory</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>requisite</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>optional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='subsysType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pci</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='capsType'/>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='pciBackend'/>
Oct 26 16:49:59 user nova-compute[75113]:     </hostdev>
Oct 26 16:49:59 user nova-compute[75113]:     <rng supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>random</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egd</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>builtin</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </rng>
Oct 26 16:49:59 user nova-compute[75113]:     <filesystem supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='driverType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>path</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>handle</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtiofs</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </filesystem>
Oct 26 16:49:59 user nova-compute[75113]:     <tpm supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-tis</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-crb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>passthrough</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>emulator</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </tpm>
Oct 26 16:49:59 user nova-compute[75113]:   </devices>
Oct 26 16:49:59 user nova-compute[75113]:   <features>
Oct 26 16:49:59 user nova-compute[75113]:     <gic supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     <vmcoreinfo supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <genid supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backingStoreInput supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backup supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <sev supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:   </features>
Oct 26 16:49:59 user nova-compute[75113]: </domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:  {{(pid=75113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 26 16:49:59 user nova-compute[75113]: <domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 16:49:59 user nova-compute[75113]:   <domain>kvm</domain>
Oct 26 16:49:59 user nova-compute[75113]:   <machine>pc-i440fx-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:   <arch>i686</arch>
Oct 26 16:49:59 user nova-compute[75113]:   <vcpu max='255'/>
Oct 26 16:49:59 user nova-compute[75113]:   <iothreads supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:   <os supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='firmware'/>
Oct 26 16:49:59 user nova-compute[75113]:     <loader supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>rom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pflash</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='readonly'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>yes</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='secure'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </loader>
Oct 26 16:49:59 user nova-compute[75113]:   </os>
Oct 26 16:49:59 user nova-compute[75113]:   <cpu>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-passthrough' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='hostPassthroughMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='maximum' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='maximumMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>on</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-model' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <vendor>Intel</vendor>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ss'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='vmx'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='pcid'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='hypervisor'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arat'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='umip'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='md-clear'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibpb'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibrs'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='erms'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='lm'/>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='custom' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>qemu64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>qemu32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>phenom</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>n270</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>kvm64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>kvm32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>coreduo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>core2duo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>athlon</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Westmere</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Snowridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Penryn</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G5</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G4</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G1</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Nehalem</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Rome</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Milan</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Dhyana</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cooperlake</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Conroe</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>486</model>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:   </cpu>
Oct 26 16:49:59 user nova-compute[75113]:   <memoryBacking supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='sourceType'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>file</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>anonymous</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>memfd</value>
Oct 26 16:49:59 user nova-compute[75113]:     </enum>
Oct 26 16:49:59 user nova-compute[75113]:   </memoryBacking>
Oct 26 16:49:59 user nova-compute[75113]:   <devices>
Oct 26 16:49:59 user nova-compute[75113]:     <disk supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='diskDevice'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>disk</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cdrom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>floppy</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>lun</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='bus'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>ide</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>fdc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sata</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </disk>
Oct 26 16:49:59 user nova-compute[75113]:     <graphics supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sdl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vnc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>spice</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egl-headless</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </graphics>
Oct 26 16:49:59 user nova-compute[75113]:     <video supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='modelType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cirrus</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vmvga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>qxl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>none</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>bochs</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>ramfb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </video>
Oct 26 16:49:59 user nova-compute[75113]:     <hostdev supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='mode'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>subsystem</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='startupPolicy'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>default</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>mandatory</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>requisite</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>optional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='subsysType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pci</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='capsType'/>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='pciBackend'/>
Oct 26 16:49:59 user nova-compute[75113]:     </hostdev>
Oct 26 16:49:59 user nova-compute[75113]:     <rng supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>random</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egd</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>builtin</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </rng>
Oct 26 16:49:59 user nova-compute[75113]:     <filesystem supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='driverType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>path</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>handle</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtiofs</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </filesystem>
Oct 26 16:49:59 user nova-compute[75113]:     <tpm supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-tis</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-crb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>passthrough</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>emulator</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </tpm>
Oct 26 16:49:59 user nova-compute[75113]:   </devices>
Oct 26 16:49:59 user nova-compute[75113]:   <features>
Oct 26 16:49:59 user nova-compute[75113]:     <gic supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     <vmcoreinfo supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <genid supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backingStoreInput supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backup supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <sev supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:   </features>
Oct 26 16:49:59 user nova-compute[75113]: </domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:  {{(pid=75113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 26 16:49:59 user nova-compute[75113]: <domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 16:49:59 user nova-compute[75113]:   <domain>kvm</domain>
Oct 26 16:49:59 user nova-compute[75113]:   <machine>pc-q35-jammy</machine>
Oct 26 16:49:59 user nova-compute[75113]:   <arch>x86_64</arch>
Oct 26 16:49:59 user nova-compute[75113]:   <vcpu max='288'/>
Oct 26 16:49:59 user nova-compute[75113]:   <iothreads supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:   <os supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='firmware'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>efi</value>
Oct 26 16:49:59 user nova-compute[75113]:     </enum>
Oct 26 16:49:59 user nova-compute[75113]:     <loader supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>rom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pflash</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='readonly'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>yes</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='secure'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>yes</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </loader>
Oct 26 16:49:59 user nova-compute[75113]:   </os>
Oct 26 16:49:59 user nova-compute[75113]:   <cpu>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-passthrough' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='hostPassthroughMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>on</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='maximum' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='maximumMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>on</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-model' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <vendor>Intel</vendor>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ss'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='vmx'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='pcid'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='hypervisor'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arat'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='umip'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='md-clear'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='invtsc'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibpb'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibrs'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='rsba'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='erms'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='custom' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>qemu64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>qemu32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>phenom</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>n270</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>kvm64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>kvm32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>coreduo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>core2duo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>athlon</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Westmere</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Snowridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Penryn</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G5</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G4</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Opteron_G1</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Nehalem</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Rome</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Milan</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Dhyana</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cooperlake</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Conroe</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>486</model>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:   </cpu>
Oct 26 16:49:59 user nova-compute[75113]:   <memoryBacking supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='sourceType'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>file</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>anonymous</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>memfd</value>
Oct 26 16:49:59 user nova-compute[75113]:     </enum>
Oct 26 16:49:59 user nova-compute[75113]:   </memoryBacking>
Oct 26 16:49:59 user nova-compute[75113]:   <devices>
Oct 26 16:49:59 user nova-compute[75113]:     <disk supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='diskDevice'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>disk</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cdrom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>floppy</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>lun</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='bus'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>fdc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sata</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </disk>
Oct 26 16:49:59 user nova-compute[75113]:     <graphics supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sdl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vnc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>spice</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egl-headless</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </graphics>
Oct 26 16:49:59 user nova-compute[75113]:     <video supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='modelType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cirrus</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vmvga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>qxl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>none</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>bochs</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>ramfb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </video>
Oct 26 16:49:59 user nova-compute[75113]:     <hostdev supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='mode'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>subsystem</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='startupPolicy'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>default</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>mandatory</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>requisite</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>optional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='subsysType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pci</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='capsType'/>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='pciBackend'/>
Oct 26 16:49:59 user nova-compute[75113]:     </hostdev>
Oct 26 16:49:59 user nova-compute[75113]:     <rng supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>random</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egd</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>builtin</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </rng>
Oct 26 16:49:59 user nova-compute[75113]:     <filesystem supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='driverType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>path</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>handle</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtiofs</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </filesystem>
Oct 26 16:49:59 user nova-compute[75113]:     <tpm supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-tis</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-crb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>passthrough</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>emulator</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </tpm>
Oct 26 16:49:59 user nova-compute[75113]:   </devices>
Oct 26 16:49:59 user nova-compute[75113]:   <features>
Oct 26 16:49:59 user nova-compute[75113]:     <gic supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     <vmcoreinfo supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <genid supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backingStoreInput supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backup supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <sev supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:   </features>
Oct 26 16:49:59 user nova-compute[75113]: </domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:  {{(pid=75113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 26 16:49:59 user nova-compute[75113]: <domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 16:49:59 user nova-compute[75113]:   <domain>kvm</domain>
Oct 26 16:49:59 user nova-compute[75113]:   <machine>pc-i440fx-jammy</machine>
Oct 26 16:49:59 user nova-compute[75113]:   <arch>x86_64</arch>
Oct 26 16:49:59 user nova-compute[75113]:   <vcpu max='255'/>
Oct 26 16:49:59 user nova-compute[75113]:   <iothreads supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:   <os supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='firmware'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>efi</value>
Oct 26 16:49:59 user nova-compute[75113]:     </enum>
Oct 26 16:49:59 user nova-compute[75113]:     <loader supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>rom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pflash</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='readonly'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>yes</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='secure'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </loader>
Oct 26 16:49:59 user nova-compute[75113]:   </os>
Oct 26 16:49:59 user nova-compute[75113]:   <cpu>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-passthrough' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='hostPassthroughMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>on</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='maximum' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='maximumMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>on</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-model' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <vendor>Intel</vendor>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ss'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='vmx'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='pcid'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='hypervisor'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arat'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='umip'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='md-clear'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='invtsc'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibpb'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibrs'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='rsba'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='erms'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='custom' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>qemu64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>qemu32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>phenom</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>n270</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>kvm64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>kvm32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>coreduo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>core2duo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>athlon</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Westmere</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Snowridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Penryn</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G5</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G4</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Opteron_G1</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Nehalem</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Rome</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Milan</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Dhyana</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cooperlake</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Conroe</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>486</model>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:   </cpu>
Oct 26 16:49:59 user nova-compute[75113]:   <memoryBacking supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='sourceType'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>file</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>anonymous</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>memfd</value>
Oct 26 16:49:59 user nova-compute[75113]:     </enum>
Oct 26 16:49:59 user nova-compute[75113]:   </memoryBacking>
Oct 26 16:49:59 user nova-compute[75113]:   <devices>
Oct 26 16:49:59 user nova-compute[75113]:     <disk supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='diskDevice'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>disk</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cdrom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>floppy</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>lun</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='bus'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>ide</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>fdc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sata</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </disk>
Oct 26 16:49:59 user nova-compute[75113]:     <graphics supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sdl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vnc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>spice</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egl-headless</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </graphics>
Oct 26 16:49:59 user nova-compute[75113]:     <video supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='modelType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cirrus</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vmvga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>qxl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>none</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>bochs</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>ramfb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </video>
Oct 26 16:49:59 user nova-compute[75113]:     <hostdev supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='mode'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>subsystem</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='startupPolicy'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>default</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>mandatory</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>requisite</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>optional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='subsysType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pci</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='capsType'/>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='pciBackend'/>
Oct 26 16:49:59 user nova-compute[75113]:     </hostdev>
Oct 26 16:49:59 user nova-compute[75113]:     <rng supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>random</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egd</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>builtin</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </rng>
Oct 26 16:49:59 user nova-compute[75113]:     <filesystem supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='driverType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>path</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>handle</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtiofs</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </filesystem>
Oct 26 16:49:59 user nova-compute[75113]:     <tpm supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-tis</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-crb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>passthrough</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>emulator</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </tpm>
Oct 26 16:49:59 user nova-compute[75113]:   </devices>
Oct 26 16:49:59 user nova-compute[75113]:   <features>
Oct 26 16:49:59 user nova-compute[75113]:     <gic supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     <vmcoreinfo supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <genid supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backingStoreInput supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backup supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <sev supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:   </features>
Oct 26 16:49:59 user nova-compute[75113]: </domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:  {{(pid=75113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 26 16:49:59 user nova-compute[75113]: <domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 16:49:59 user nova-compute[75113]:   <domain>kvm</domain>
Oct 26 16:49:59 user nova-compute[75113]:   <machine>pc-q35-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:   <arch>x86_64</arch>
Oct 26 16:49:59 user nova-compute[75113]:   <vcpu max='288'/>
Oct 26 16:49:59 user nova-compute[75113]:   <iothreads supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:   <os supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='firmware'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>efi</value>
Oct 26 16:49:59 user nova-compute[75113]:     </enum>
Oct 26 16:49:59 user nova-compute[75113]:     <loader supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>rom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pflash</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='readonly'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>yes</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='secure'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>yes</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </loader>
Oct 26 16:49:59 user nova-compute[75113]:   </os>
Oct 26 16:49:59 user nova-compute[75113]:   <cpu>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-passthrough' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='hostPassthroughMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>on</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='maximum' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='maximumMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>on</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-model' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <vendor>Intel</vendor>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ss'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='vmx'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='pcid'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='hypervisor'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arat'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='umip'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='md-clear'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='invtsc'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibpb'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibrs'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='rsba'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='erms'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='custom' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>qemu64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>qemu32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>phenom</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>n270</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>kvm64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>kvm32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>coreduo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>core2duo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>athlon</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Westmere</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Snowridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Penryn</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G5</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G4</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Opteron_G1</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Nehalem</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Rome</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Milan</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Dhyana</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cooperlake</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Conroe</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>486</model>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:   </cpu>
Oct 26 16:49:59 user nova-compute[75113]:   <memoryBacking supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='sourceType'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>file</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>anonymous</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>memfd</value>
Oct 26 16:49:59 user nova-compute[75113]:     </enum>
Oct 26 16:49:59 user nova-compute[75113]:   </memoryBacking>
Oct 26 16:49:59 user nova-compute[75113]:   <devices>
Oct 26 16:49:59 user nova-compute[75113]:     <disk supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='diskDevice'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>disk</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cdrom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>floppy</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>lun</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='bus'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>fdc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sata</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </disk>
Oct 26 16:49:59 user nova-compute[75113]:     <graphics supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sdl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vnc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>spice</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egl-headless</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </graphics>
Oct 26 16:49:59 user nova-compute[75113]:     <video supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='modelType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cirrus</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vmvga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>qxl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>none</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>bochs</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>ramfb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </video>
Oct 26 16:49:59 user nova-compute[75113]:     <hostdev supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='mode'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>subsystem</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='startupPolicy'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>default</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>mandatory</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>requisite</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>optional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='subsysType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pci</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='capsType'/>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='pciBackend'/>
Oct 26 16:49:59 user nova-compute[75113]:     </hostdev>
Oct 26 16:49:59 user nova-compute[75113]:     <rng supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>random</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egd</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>builtin</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </rng>
Oct 26 16:49:59 user nova-compute[75113]:     <filesystem supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='driverType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>path</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>handle</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtiofs</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </filesystem>
Oct 26 16:49:59 user nova-compute[75113]:     <tpm supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-tis</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-crb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>passthrough</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>emulator</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </tpm>
Oct 26 16:49:59 user nova-compute[75113]:   </devices>
Oct 26 16:49:59 user nova-compute[75113]:   <features>
Oct 26 16:49:59 user nova-compute[75113]:     <gic supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     <vmcoreinfo supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <genid supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backingStoreInput supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backup supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <sev supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:   </features>
Oct 26 16:49:59 user nova-compute[75113]: </domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:  {{(pid=75113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 26 16:49:59 user nova-compute[75113]: <domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 16:49:59 user nova-compute[75113]:   <domain>kvm</domain>
Oct 26 16:49:59 user nova-compute[75113]:   <machine>pc-i440fx-6.2</machine>
Oct 26 16:49:59 user nova-compute[75113]:   <arch>x86_64</arch>
Oct 26 16:49:59 user nova-compute[75113]:   <vcpu max='255'/>
Oct 26 16:49:59 user nova-compute[75113]:   <iothreads supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:   <os supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='firmware'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>efi</value>
Oct 26 16:49:59 user nova-compute[75113]:     </enum>
Oct 26 16:49:59 user nova-compute[75113]:     <loader supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>rom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pflash</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='readonly'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>yes</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='secure'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>no</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </loader>
Oct 26 16:49:59 user nova-compute[75113]:   </os>
Oct 26 16:49:59 user nova-compute[75113]:   <cpu>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-passthrough' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='hostPassthroughMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>on</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='maximum' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='maximumMigratable'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>on</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>off</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='host-model' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <vendor>Intel</vendor>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ss'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='vmx'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='pcid'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='hypervisor'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arat'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='umip'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='md-clear'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='invtsc'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibpb'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='ibrs'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-stibp'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='rsba'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='erms'/>
Oct 26 16:49:59 user nova-compute[75113]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:     <mode name='custom' supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>qemu64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>qemu32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>phenom</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>pentium</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>n270</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>kvm64</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>kvm32</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>coreduo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>core2duo</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>athlon</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Westmere</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Snowridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Skylake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>SandyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Penryn</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G5</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G4</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G3</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Opteron_G2</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Opteron_G1</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Nehalem</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>IvyBridge</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Icelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Haswell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Rome</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-Milan</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>EPYC</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Dhyana</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cooperlake</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>Conroe</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='no'>Broadwell</model>
Oct 26 16:49:59 user nova-compute[75113]:       <model usable='yes'>486</model>
Oct 26 16:49:59 user nova-compute[75113]:     </mode>
Oct 26 16:49:59 user nova-compute[75113]:   </cpu>
Oct 26 16:49:59 user nova-compute[75113]:   <memoryBacking supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:     <enum name='sourceType'>
Oct 26 16:49:59 user nova-compute[75113]:       <value>file</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>anonymous</value>
Oct 26 16:49:59 user nova-compute[75113]:       <value>memfd</value>
Oct 26 16:49:59 user nova-compute[75113]:     </enum>
Oct 26 16:49:59 user nova-compute[75113]:   </memoryBacking>
Oct 26 16:49:59 user nova-compute[75113]:   <devices>
Oct 26 16:49:59 user nova-compute[75113]:     <disk supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='diskDevice'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>disk</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cdrom</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>floppy</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>lun</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='bus'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>ide</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>fdc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sata</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </disk>
Oct 26 16:49:59 user nova-compute[75113]:     <graphics supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='type'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>sdl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vnc</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>spice</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egl-headless</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </graphics>
Oct 26 16:49:59 user nova-compute[75113]:     <video supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='modelType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>cirrus</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>vmvga</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>qxl</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>none</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>bochs</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>ramfb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </video>
Oct 26 16:49:59 user nova-compute[75113]:     <hostdev supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='mode'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>subsystem</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='startupPolicy'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>default</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>mandatory</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>requisite</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>optional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='subsysType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>usb</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>pci</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>scsi</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='capsType'/>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='pciBackend'/>
Oct 26 16:49:59 user nova-compute[75113]:     </hostdev>
Oct 26 16:49:59 user nova-compute[75113]:     <rng supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtio-non-transitional</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>random</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>egd</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>builtin</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </rng>
Oct 26 16:49:59 user nova-compute[75113]:     <filesystem supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='driverType'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>path</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>handle</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>virtiofs</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </filesystem>
Oct 26 16:49:59 user nova-compute[75113]:     <tpm supported='yes'>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='model'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-tis</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>tpm-crb</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:       <enum name='backendModel'>
Oct 26 16:49:59 user nova-compute[75113]:         <value>passthrough</value>
Oct 26 16:49:59 user nova-compute[75113]:         <value>emulator</value>
Oct 26 16:49:59 user nova-compute[75113]:       </enum>
Oct 26 16:49:59 user nova-compute[75113]:     </tpm>
Oct 26 16:49:59 user nova-compute[75113]:   </devices>
Oct 26 16:49:59 user nova-compute[75113]:   <features>
Oct 26 16:49:59 user nova-compute[75113]:     <gic supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:     <vmcoreinfo supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <genid supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backingStoreInput supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <backup supported='yes'/>
Oct 26 16:49:59 user nova-compute[75113]:     <sev supported='no'/>
Oct 26 16:49:59 user nova-compute[75113]:   </features>
Oct 26 16:49:59 user nova-compute[75113]: </domainCapabilities>
Oct 26 16:49:59 user nova-compute[75113]:  {{(pid=75113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Checking secure boot support for host arch (x86_64) {{(pid=75113) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 16:49:59 user nova-compute[75113]: INFO nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Secure Boot support detected
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] cpu compare xml: <cpu match="exact">
Oct 26 16:49:59 user nova-compute[75113]:   <model>Nehalem</model>
Oct 26 16:49:59 user nova-compute[75113]: </cpu>
Oct 26 16:49:59 user nova-compute[75113]:  {{(pid=75113) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 26 16:49:59 user nova-compute[75113]: INFO nova.virt.node [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Generated node identity c33cb59b-e90a-48cc-9491-b92264d66bd5
Oct 26 16:49:59 user nova-compute[75113]: INFO nova.virt.node [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Wrote node identity c33cb59b-e90a-48cc-9491-b92264d66bd5 to /opt/stack/data/nova/compute_id
Oct 26 16:49:59 user nova-compute[75113]: WARNING nova.compute.manager [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Compute nodes ['c33cb59b-e90a-48cc-9491-b92264d66bd5'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 26 16:49:59 user nova-compute[75113]: INFO nova.compute.manager [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 26 16:49:59 user nova-compute[75113]: WARNING nova.compute.manager [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 26 16:49:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:49:59 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:50:00 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:50:00 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Hypervisor/Node resource view: name=user free_ram=10928MB free_disk=26.141460418701172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:50:00 user nova-compute[75113]: WARNING nova.compute.resource_tracker [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] No compute node record for user:c33cb59b-e90a-48cc-9491-b92264d66bd5: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host c33cb59b-e90a-48cc-9491-b92264d66bd5 could not be found.
Oct 26 16:50:00 user nova-compute[75113]: INFO nova.compute.resource_tracker [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Compute node record created for user:user with uuid: c33cb59b-e90a-48cc-9491-b92264d66bd5
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:50:00 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] [req-8b0e2d96-4636-4b0a-b5e8-ff4f43601f7f] Created resource provider record via placement API for resource provider with UUID c33cb59b-e90a-48cc-9491-b92264d66bd5 and name user.
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75113) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 26 16:50:00 user nova-compute[75113]: INFO nova.virt.libvirt.host [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] kernel doesn't support AMD SEV
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Updating inventory in ProviderTree for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Libvirt baseline CPU <cpu>
Oct 26 16:50:00 user nova-compute[75113]:   <arch>x86_64</arch>
Oct 26 16:50:00 user nova-compute[75113]:   <model>Nehalem</model>
Oct 26 16:50:00 user nova-compute[75113]:   <vendor>Intel</vendor>
Oct 26 16:50:00 user nova-compute[75113]:   <topology sockets="6" cores="1" threads="1"/>
Oct 26 16:50:00 user nova-compute[75113]: </cpu>
Oct 26 16:50:00 user nova-compute[75113]:  {{(pid=75113) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Updated inventory for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Updating resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5 generation from 0 to 1 during operation: update_inventory {{(pid=75113) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Updating inventory in ProviderTree for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Updating resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5 generation from 1 to 2 during operation: update_traits {{(pid=75113) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.670s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.service [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Creating RPC server for service compute {{(pid=75113) start /opt/stack/nova/nova/service.py:182}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.service [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] Join ServiceGroup membership for this service compute {{(pid=75113) start /opt/stack/nova/nova/service.py:199}}
Oct 26 16:50:00 user nova-compute[75113]: DEBUG nova.servicegroup.drivers.db [None req-f0dcc01d-def9-4582-8f16-8351068a5a90 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75113) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:50:55 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:50:56 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:50:56 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:50:56 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=10350MB free_disk=26.045143127441406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:50:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:50:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:50:56 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:50:56 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:50:56 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:50:56 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:50:56 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:50:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:50:56 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:51:51 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:51:51 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:51:52 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:51:52 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:51:52 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=10293MB free_disk=26.10928726196289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:51:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:51:53 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:51:53 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:52:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:52:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:52:53 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:52:53 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:52:53 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=10297MB free_disk=25.86290740966797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:52:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:52:54 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:52:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:52:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 16:52:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 16:52:54 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:52:54 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:52:54 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:52:54 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:52:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:53:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:53:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:53:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:53:53 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:53:54 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:53:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:53:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 16:53:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:53:55 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:53:55 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:53:55 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=9586MB free_disk=25.88274383544922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:53:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:53:56 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:53:56 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:53:56 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:53:56 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:54:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:54:05 user nova-compute[75113]: INFO nova.compute.claims [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Claim successful on node user
Oct 26 16:54:05 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG nova.network.neutron [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:54:05 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:54:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:54:05 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Creating image(s)
Oct 26 16:54:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "/opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "/opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0.part --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:06 user nova-compute[75113]: DEBUG nova.policy [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a2fb42c068a49d88c94b67044216201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b8c64bc7f4d19b3a84d83dbebc813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:54:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:06 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:54:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0.part --force-share --output=json" returned: 0 in 0.204s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:06 user nova-compute[75113]: DEBUG nova.virt.images [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] 91603055-2c31-464d-bb00-ae160ab6e467 was qcow2, converting to raw {{(pid=75113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 16:54:06 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 16:54:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0.part /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0.converted {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:54:06 user nova-compute[75113]: INFO nova.compute.claims [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Claim successful on node user
Oct 26 16:54:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0.part /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0.converted" returned: 0 in 0.269s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0.converted --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.151s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:07 user nova-compute[75113]: INFO oslo.privsep.daemon [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp62dhkt9b/privsep.sock']
Oct 26 16:54:07 user sudo[84360]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp62dhkt9b/privsep.sock
Oct 26 16:54:07 user sudo[84360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 16:54:07 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:54:07 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:54:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:07 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:54:07 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:54:07 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:54:07 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:54:07 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:54:07 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:54:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:54:07 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Creating image(s)
Oct 26 16:54:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "/opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "/opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "/opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:07 user nova-compute[75113]: DEBUG nova.policy [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38f45ddba3b44d1b9333b282e43b02e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992a6be3e5814c3b80c705763af5de1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:54:08 user sudo[84360]: pam_unix(sudo:session): session closed for user root
Oct 26 16:54:08 user nova-compute[75113]: INFO oslo.privsep.daemon [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Spawned new privsep daemon via rootwrap
Oct 26 16:54:08 user nova-compute[75113]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 16:54:08 user nova-compute[75113]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 16:54:08 user nova-compute[75113]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 26 16:54:08 user nova-compute[75113]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84365
Oct 26 16:54:08 user nova-compute[75113]: WARNING oslo_privsep.priv_context [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] privsep daemon already running
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "69ed2396-a603-4c84-a66b-7b474523b68e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.207s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.237s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:54:09 user nova-compute[75113]: INFO nova.compute.claims [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Claim successful on node user
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG nova.network.neutron [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Successfully created port: c66a2219-e937-4d6b-8c1c-275d9f4ee094 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk 1073741824" returned: 0 in 0.065s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.240s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.203s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Successfully created port: 96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk 1073741824" returned: 0 in 0.092s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Cannot resize image /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Ensure instance console log exists: /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:54:09 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.167s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Checking if we can resize image /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.719s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG nova.network.neutron [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:54:10 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:54:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Cannot resize image /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Ensure instance console log exists: /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:54:10 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Creating image(s)
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "/opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "/opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "/opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.156s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk 1073741824" returned: 0 in 0.047s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG nova.policy [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '289e367da4e444a791a556dafb7ec392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992dea425f6241c2b94c1a1c970cb028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.173s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:54:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:11 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Cannot resize image /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:54:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:54:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Ensure instance console log exists: /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:54:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Successfully updated port: 96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquired lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.compute.manager [req-864ff594-d173-4041-946d-21286182a4c1 req-7cba69db-bcdb-40db-a819-7e9dc5b718a3 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-changed-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.compute.manager [req-864ff594-d173-4041-946d-21286182a4c1 req-7cba69db-bcdb-40db-a819-7e9dc5b718a3 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Refreshing instance network info cache due to event network-changed-96d708f7-00f7-44af-9bc6-43882921ea03. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-864ff594-d173-4041-946d-21286182a4c1 req-7cba69db-bcdb-40db-a819-7e9dc5b718a3 service nova] Acquiring lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating instance_info_cache with network_info: [{"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Releasing lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Instance network_info: |[{"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-864ff594-d173-4041-946d-21286182a4c1 req-7cba69db-bcdb-40db-a819-7e9dc5b718a3 service nova] Acquired lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.network.neutron [req-864ff594-d173-4041-946d-21286182a4c1 req-7cba69db-bcdb-40db-a819-7e9dc5b718a3 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Refreshing network info cache for port 96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Start _get_guest_xml network_info=[{"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:54:12 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:12 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:54:12 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1163194343',display_name='tempest-ServerActionsTestOtherB-server-1163194343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1163194343',id=2,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNi6S0kdc5pWvhxq2azP5QRonb6qXMUiteND1nfP3Uf2jZWYfGzWg8fbqOsk4PAj062T9NqyLIEevO2i2GpMs0q5myp5A+SX7ogwodc86c3yyzOTm1sjFsenkun5EW0fg==',key_name='tempest-keypair-1305775717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='992a6be3e5814c3b80c705763af5de1e',ramdisk_id='',reservation_id='r-fvz5sf1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1008157220',owner_user_name='tempest-ServerActionsTestOtherB-1008157220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f45ddba3b44d1b9333b282e43b02e8',uuid=645deae0-4c03-41d0-aa3b-daa79ed25425,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converting VIF {"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG nova.objects.instance [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lazy-loading 'pci_devices' on Instance uuid 645deae0-4c03-41d0-aa3b-daa79ed25425 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:54:13 user nova-compute[75113]:   <uuid>645deae0-4c03-41d0-aa3b-daa79ed25425</uuid>
Oct 26 16:54:13 user nova-compute[75113]:   <name>instance-00000002</name>
Oct 26 16:54:13 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:54:13 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:54:13 user nova-compute[75113]:   <metadata>
Oct 26 16:54:13 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:54:13 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:54:13 user nova-compute[75113]:       <nova:name>tempest-ServerActionsTestOtherB-server-1163194343</nova:name>
Oct 26 16:54:13 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:54:12</nova:creationTime>
Oct 26 16:54:13 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:54:13 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:54:13 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:54:13 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:54:13 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:54:13 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:54:13 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:54:13 user nova-compute[75113]:       <nova:owner>
Oct 26 16:54:13 user nova-compute[75113]:         <nova:user uuid="38f45ddba3b44d1b9333b282e43b02e8">tempest-ServerActionsTestOtherB-1008157220-project-member</nova:user>
Oct 26 16:54:13 user nova-compute[75113]:         <nova:project uuid="992a6be3e5814c3b80c705763af5de1e">tempest-ServerActionsTestOtherB-1008157220</nova:project>
Oct 26 16:54:13 user nova-compute[75113]:       </nova:owner>
Oct 26 16:54:13 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:54:13 user nova-compute[75113]:       <nova:ports>
Oct 26 16:54:13 user nova-compute[75113]:         <nova:port uuid="96d708f7-00f7-44af-9bc6-43882921ea03">
Oct 26 16:54:13 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 16:54:13 user nova-compute[75113]:         </nova:port>
Oct 26 16:54:13 user nova-compute[75113]:       </nova:ports>
Oct 26 16:54:13 user nova-compute[75113]:     </nova:instance>
Oct 26 16:54:13 user nova-compute[75113]:   </metadata>
Oct 26 16:54:13 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:54:13 user nova-compute[75113]:     <system>
Oct 26 16:54:13 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:54:13 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:54:13 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:54:13 user nova-compute[75113]:       <entry name="serial">645deae0-4c03-41d0-aa3b-daa79ed25425</entry>
Oct 26 16:54:13 user nova-compute[75113]:       <entry name="uuid">645deae0-4c03-41d0-aa3b-daa79ed25425</entry>
Oct 26 16:54:13 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:54:13 user nova-compute[75113]:     </system>
Oct 26 16:54:13 user nova-compute[75113]:   </sysinfo>
Oct 26 16:54:13 user nova-compute[75113]:   <os>
Oct 26 16:54:13 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:54:13 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:54:13 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:54:13 user nova-compute[75113]:   </os>
Oct 26 16:54:13 user nova-compute[75113]:   <features>
Oct 26 16:54:13 user nova-compute[75113]:     <acpi/>
Oct 26 16:54:13 user nova-compute[75113]:     <apic/>
Oct 26 16:54:13 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:54:13 user nova-compute[75113]:   </features>
Oct 26 16:54:13 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:54:13 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:54:13 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:54:13 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:54:13 user nova-compute[75113]:   </clock>
Oct 26 16:54:13 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:54:13 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:54:13 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:54:13 user nova-compute[75113]:   </cpu>
Oct 26 16:54:13 user nova-compute[75113]:   <devices>
Oct 26 16:54:13 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:54:13 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:54:13 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk"/>
Oct 26 16:54:13 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:54:13 user nova-compute[75113]:     </disk>
Oct 26 16:54:13 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:54:13 user nova-compute[75113]:       <mac address="fa:16:3e:0e:ed:4e"/>
Oct 26 16:54:13 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:13 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:54:13 user nova-compute[75113]:       <target dev="tap96d708f7-00"/>
Oct 26 16:54:13 user nova-compute[75113]:     </interface>
Oct 26 16:54:13 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:54:13 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/console.log" append="off"/>
Oct 26 16:54:13 user nova-compute[75113]:     </serial>
Oct 26 16:54:13 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:54:13 user nova-compute[75113]:     <video>
Oct 26 16:54:13 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:13 user nova-compute[75113]:     </video>
Oct 26 16:54:13 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:54:13 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:54:13 user nova-compute[75113]:     </rng>
Oct 26 16:54:13 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:54:13 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:54:13 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:54:13 user nova-compute[75113]:     </memballoon>
Oct 26 16:54:13 user nova-compute[75113]:   </devices>
Oct 26 16:54:13 user nova-compute[75113]: </domain>
Oct 26 16:54:13 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1163194343',display_name='tempest-ServerActionsTestOtherB-server-1163194343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1163194343',id=2,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNi6S0kdc5pWvhxq2azP5QRonb6qXMUiteND1nfP3Uf2jZWYfGzWg8fbqOsk4PAj062T9NqyLIEevO2i2GpMs0q5myp5A+SX7ogwodc86c3yyzOTm1sjFsenkun5EW0fg==',key_name='tempest-keypair-1305775717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='992a6be3e5814c3b80c705763af5de1e',ramdisk_id='',reservation_id='r-fvz5sf1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1008157220',owner_user_name='tempest-ServerActionsTestOtherB-1008157220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f45ddba3b44d1b9333b282e43b02e8',uuid=645deae0-4c03-41d0-aa3b-daa79ed25425,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converting VIF {"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG os_vif [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Created schema index Interface.name {{(pid=75113) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Created schema index Port.name {{(pid=75113) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Created schema index Bridge.name {{(pid=75113) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [POLLOUT] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac662543-30ce-5fd8-bd5e-0ffbbb41a931', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:54:13 user nova-compute[75113]: INFO oslo.privsep.daemon [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp4zx9vov7/privsep.sock']
Oct 26 16:54:13 user sudo[84419]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp4zx9vov7/privsep.sock
Oct 26 16:54:13 user sudo[84419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 16:54:14 user nova-compute[75113]: DEBUG nova.network.neutron [req-864ff594-d173-4041-946d-21286182a4c1 req-7cba69db-bcdb-40db-a819-7e9dc5b718a3 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updated VIF entry in instance network info cache for port 96d708f7-00f7-44af-9bc6-43882921ea03. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:54:14 user nova-compute[75113]: DEBUG nova.network.neutron [req-864ff594-d173-4041-946d-21286182a4c1 req-7cba69db-bcdb-40db-a819-7e9dc5b718a3 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating instance_info_cache with network_info: [{"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-864ff594-d173-4041-946d-21286182a4c1 req-7cba69db-bcdb-40db-a819-7e9dc5b718a3 service nova] Releasing lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Successfully updated port: c66a2219-e937-4d6b-8c1c-275d9f4ee094 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:54:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "refresh_cache-ea7b1250-2387-491b-ac27-e1d3d27a13d2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquired lock "refresh_cache-ea7b1250-2387-491b-ac27-e1d3d27a13d2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:54:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:14 user sudo[84419]: pam_unix(sudo:session): session closed for user root
Oct 26 16:54:14 user nova-compute[75113]: INFO oslo.privsep.daemon [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Spawned new privsep daemon via rootwrap
Oct 26 16:54:14 user nova-compute[75113]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 16:54:14 user nova-compute[75113]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 16:54:14 user nova-compute[75113]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 26 16:54:14 user nova-compute[75113]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84425
Oct 26 16:54:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:54:15 user nova-compute[75113]: DEBUG nova.compute.manager [req-186022da-fd8a-4218-8a80-4bb5fd3b0502 req-e558b92c-9058-449a-b908-05759456bcd5 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Received event network-changed-c66a2219-e937-4d6b-8c1c-275d9f4ee094 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:15 user nova-compute[75113]: DEBUG nova.compute.manager [req-186022da-fd8a-4218-8a80-4bb5fd3b0502 req-e558b92c-9058-449a-b908-05759456bcd5 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Refreshing instance network info cache due to event network-changed-c66a2219-e937-4d6b-8c1c-275d9f4ee094. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:54:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-186022da-fd8a-4218-8a80-4bb5fd3b0502 req-e558b92c-9058-449a-b908-05759456bcd5 service nova] Acquiring lock "refresh_cache-ea7b1250-2387-491b-ac27-e1d3d27a13d2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96d708f7-00, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96d708f7-00, col_values=(('qos', UUID('2c930e16-dfa4-41a6-bd64-b19f344da0ce')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96d708f7-00, col_values=(('external_ids', {'iface-id': '96d708f7-00f7-44af-9bc6-43882921ea03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:ed:4e', 'vm-uuid': '645deae0-4c03-41d0-aa3b-daa79ed25425'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:54:15 user nova-compute[75113]: INFO os_vif [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00')
Oct 26 16:54:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:54:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] No VIF found with MAC fa:16:3e:0e:ed:4e, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:54:15 user nova-compute[75113]: DEBUG nova.network.neutron [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Successfully created port: 0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.network.neutron [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Updating instance_info_cache with network_info: [{"id": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "address": "fa:16:3e:1f:74:4a", "network": {"id": "70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-479778024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b8c64bc7f4d19b3a84d83dbebc813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a2219-e9", "ovs_interfaceid": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Releasing lock "refresh_cache-ea7b1250-2387-491b-ac27-e1d3d27a13d2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Instance network_info: |[{"id": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "address": "fa:16:3e:1f:74:4a", "network": {"id": "70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-479778024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b8c64bc7f4d19b3a84d83dbebc813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a2219-e9", "ovs_interfaceid": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-186022da-fd8a-4218-8a80-4bb5fd3b0502 req-e558b92c-9058-449a-b908-05759456bcd5 service nova] Acquired lock "refresh_cache-ea7b1250-2387-491b-ac27-e1d3d27a13d2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.network.neutron [req-186022da-fd8a-4218-8a80-4bb5fd3b0502 req-e558b92c-9058-449a-b908-05759456bcd5 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Refreshing network info cache for port c66a2219-e937-4d6b-8c1c-275d9f4ee094 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Start _get_guest_xml network_info=[{"id": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "address": "fa:16:3e:1f:74:4a", "network": {"id": "70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-479778024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b8c64bc7f4d19b3a84d83dbebc813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a2219-e9", "ovs_interfaceid": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:54:16 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:16 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1783769704',display_name='tempest-DeleteServersTestJSON-server-1783769704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1783769704',id=1,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548b8c64bc7f4d19b3a84d83dbebc813',ramdisk_id='',reservation_id='r-ykqs7d4h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1739635469',owner_user_name='tempest-DeleteServersTestJSON-1739635469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:06Z,user_data=None,user_id='2a2fb42c068a49d88c94b67044216201',uuid=ea7b1250-2387-491b-ac27-e1d3d27a13d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "address": "fa:16:3e:1f:74:4a", "network": {"id": "70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-479778024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b8c64bc7f4d19b3a84d83dbebc813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a2219-e9", "ovs_interfaceid": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Converting VIF {"id": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "address": "fa:16:3e:1f:74:4a", "network": {"id": "70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-479778024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b8c64bc7f4d19b3a84d83dbebc813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a2219-e9", "ovs_interfaceid": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:74:4a,bridge_name='br-int',has_traffic_filtering=True,id=c66a2219-e937-4d6b-8c1c-275d9f4ee094,network=Network(70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a2219-e9') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.objects.instance [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lazy-loading 'pci_devices' on Instance uuid ea7b1250-2387-491b-ac27-e1d3d27a13d2 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:54:16 user nova-compute[75113]:   <uuid>ea7b1250-2387-491b-ac27-e1d3d27a13d2</uuid>
Oct 26 16:54:16 user nova-compute[75113]:   <name>instance-00000001</name>
Oct 26 16:54:16 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:54:16 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:54:16 user nova-compute[75113]:   <metadata>
Oct 26 16:54:16 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:54:16 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:54:16 user nova-compute[75113]:       <nova:name>tempest-DeleteServersTestJSON-server-1783769704</nova:name>
Oct 26 16:54:16 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:54:16</nova:creationTime>
Oct 26 16:54:16 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:54:16 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:54:16 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:54:16 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:54:16 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:54:16 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:54:16 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:54:16 user nova-compute[75113]:       <nova:owner>
Oct 26 16:54:16 user nova-compute[75113]:         <nova:user uuid="2a2fb42c068a49d88c94b67044216201">tempest-DeleteServersTestJSON-1739635469-project-member</nova:user>
Oct 26 16:54:16 user nova-compute[75113]:         <nova:project uuid="548b8c64bc7f4d19b3a84d83dbebc813">tempest-DeleteServersTestJSON-1739635469</nova:project>
Oct 26 16:54:16 user nova-compute[75113]:       </nova:owner>
Oct 26 16:54:16 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:54:16 user nova-compute[75113]:       <nova:ports>
Oct 26 16:54:16 user nova-compute[75113]:         <nova:port uuid="c66a2219-e937-4d6b-8c1c-275d9f4ee094">
Oct 26 16:54:16 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 16:54:16 user nova-compute[75113]:         </nova:port>
Oct 26 16:54:16 user nova-compute[75113]:       </nova:ports>
Oct 26 16:54:16 user nova-compute[75113]:     </nova:instance>
Oct 26 16:54:16 user nova-compute[75113]:   </metadata>
Oct 26 16:54:16 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:54:16 user nova-compute[75113]:     <system>
Oct 26 16:54:16 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:54:16 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:54:16 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:54:16 user nova-compute[75113]:       <entry name="serial">ea7b1250-2387-491b-ac27-e1d3d27a13d2</entry>
Oct 26 16:54:16 user nova-compute[75113]:       <entry name="uuid">ea7b1250-2387-491b-ac27-e1d3d27a13d2</entry>
Oct 26 16:54:16 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:54:16 user nova-compute[75113]:     </system>
Oct 26 16:54:16 user nova-compute[75113]:   </sysinfo>
Oct 26 16:54:16 user nova-compute[75113]:   <os>
Oct 26 16:54:16 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:54:16 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:54:16 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:54:16 user nova-compute[75113]:   </os>
Oct 26 16:54:16 user nova-compute[75113]:   <features>
Oct 26 16:54:16 user nova-compute[75113]:     <acpi/>
Oct 26 16:54:16 user nova-compute[75113]:     <apic/>
Oct 26 16:54:16 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:54:16 user nova-compute[75113]:   </features>
Oct 26 16:54:16 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:54:16 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:54:16 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:54:16 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:54:16 user nova-compute[75113]:   </clock>
Oct 26 16:54:16 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:54:16 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:54:16 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:54:16 user nova-compute[75113]:   </cpu>
Oct 26 16:54:16 user nova-compute[75113]:   <devices>
Oct 26 16:54:16 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:54:16 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:54:16 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk"/>
Oct 26 16:54:16 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:54:16 user nova-compute[75113]:     </disk>
Oct 26 16:54:16 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:54:16 user nova-compute[75113]:       <mac address="fa:16:3e:1f:74:4a"/>
Oct 26 16:54:16 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:16 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:54:16 user nova-compute[75113]:       <target dev="tapc66a2219-e9"/>
Oct 26 16:54:16 user nova-compute[75113]:     </interface>
Oct 26 16:54:16 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:54:16 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/console.log" append="off"/>
Oct 26 16:54:16 user nova-compute[75113]:     </serial>
Oct 26 16:54:16 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:54:16 user nova-compute[75113]:     <video>
Oct 26 16:54:16 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:16 user nova-compute[75113]:     </video>
Oct 26 16:54:16 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:54:16 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:54:16 user nova-compute[75113]:     </rng>
Oct 26 16:54:16 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:54:16 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:54:16 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:54:16 user nova-compute[75113]:     </memballoon>
Oct 26 16:54:16 user nova-compute[75113]:   </devices>
Oct 26 16:54:16 user nova-compute[75113]: </domain>
Oct 26 16:54:16 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1783769704',display_name='tempest-DeleteServersTestJSON-server-1783769704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1783769704',id=1,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548b8c64bc7f4d19b3a84d83dbebc813',ramdisk_id='',reservation_id='r-ykqs7d4h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1739635469',owner_user_name='tempest-DeleteServersTestJSON-1739635469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:06Z,user_data=None,user_id='2a2fb42c068a49d88c94b67044216201',uuid=ea7b1250-2387-491b-ac27-e1d3d27a13d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "address": "fa:16:3e:1f:74:4a", "network": {"id": "70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-479778024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b8c64bc7f4d19b3a84d83dbebc813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a2219-e9", "ovs_interfaceid": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Converting VIF {"id": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "address": "fa:16:3e:1f:74:4a", "network": {"id": "70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-479778024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b8c64bc7f4d19b3a84d83dbebc813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a2219-e9", "ovs_interfaceid": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:74:4a,bridge_name='br-int',has_traffic_filtering=True,id=c66a2219-e937-4d6b-8c1c-275d9f4ee094,network=Network(70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a2219-e9') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG os_vif [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:74:4a,bridge_name='br-int',has_traffic_filtering=True,id=c66a2219-e937-4d6b-8c1c-275d9f4ee094,network=Network(70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a2219-e9') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '841849f1-f45f-5725-a9df-50617aa264b4', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc66a2219-e9, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc66a2219-e9, col_values=(('qos', UUID('ac1ec1f2-6eb8-4e0a-9f0a-7da3beff7ffe')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc66a2219-e9, col_values=(('external_ids', {'iface-id': 'c66a2219-e937-4d6b-8c1c-275d9f4ee094', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:74:4a', 'vm-uuid': 'ea7b1250-2387-491b-ac27-e1d3d27a13d2'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:16 user nova-compute[75113]: INFO os_vif [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:74:4a,bridge_name='br-int',has_traffic_filtering=True,id=c66a2219-e937-4d6b-8c1c-275d9f4ee094,network=Network(70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a2219-e9')
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] No VIF found with MAC fa:16:3e:1f:74:4a, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:18 user nova-compute[75113]: DEBUG nova.network.neutron [req-186022da-fd8a-4218-8a80-4bb5fd3b0502 req-e558b92c-9058-449a-b908-05759456bcd5 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Updated VIF entry in instance network info cache for port c66a2219-e937-4d6b-8c1c-275d9f4ee094. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:54:18 user nova-compute[75113]: DEBUG nova.network.neutron [req-186022da-fd8a-4218-8a80-4bb5fd3b0502 req-e558b92c-9058-449a-b908-05759456bcd5 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Updating instance_info_cache with network_info: [{"id": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "address": "fa:16:3e:1f:74:4a", "network": {"id": "70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-479778024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b8c64bc7f4d19b3a84d83dbebc813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a2219-e9", "ovs_interfaceid": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-186022da-fd8a-4218-8a80-4bb5fd3b0502 req-e558b92c-9058-449a-b908-05759456bcd5 service nova] Releasing lock "refresh_cache-ea7b1250-2387-491b-ac27-e1d3d27a13d2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:19 user nova-compute[75113]: DEBUG nova.network.neutron [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Successfully updated port: 0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:54:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquired lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:19 user nova-compute[75113]: DEBUG nova.network.neutron [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:54:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-e33113f5-a9a7-41bf-838c-aad3f6b5f63c req-5dc82b8f-76f3-4f5e-8fbd-6e847c4455d9 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-changed-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-e33113f5-a9a7-41bf-838c-aad3f6b5f63c req-5dc82b8f-76f3-4f5e-8fbd-6e847c4455d9 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Refreshing instance network info cache due to event network-changed-0502d8bd-666e-4f27-8c38-e060b44ce264. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:54:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e33113f5-a9a7-41bf-838c-aad3f6b5f63c req-5dc82b8f-76f3-4f5e-8fbd-6e847c4455d9 service nova] Acquiring lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:19 user nova-compute[75113]: DEBUG nova.network.neutron [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:54:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:54:20 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Instance spawned successfully.
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.network.neutron [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updating instance_info_cache with network_info: [{"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Releasing lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Instance network_info: |[{"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e33113f5-a9a7-41bf-838c-aad3f6b5f63c req-5dc82b8f-76f3-4f5e-8fbd-6e847c4455d9 service nova] Acquired lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.network.neutron [req-e33113f5-a9a7-41bf-838c-aad3f6b5f63c req-5dc82b8f-76f3-4f5e-8fbd-6e847c4455d9 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Refreshing network info cache for port 0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Start _get_guest_xml network_info=[{"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:54:20 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Instance spawned successfully.
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:54:20 user nova-compute[75113]: INFO nova.compute.manager [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Took 12.62 seconds to spawn the instance on the hypervisor.
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:54:20 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:20 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1913117266',display_name='tempest-ServerStableDeviceRescueTest-server-1913117266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1913117266',id=3,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW+UVAaeZhsHcgJPMCTV2xrTl4CNLS+MkerMjXHgsZ/82ki6sNGkNDlnGa3RyBILee0xpxEsN4D9jct3D9FBDbCeR7Aa5wxdczxapjdNt9OslE9CMc4aivD8gDSXppcbA==',key_name='tempest-keypair-522693316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='992dea425f6241c2b94c1a1c970cb028',ramdisk_id='',reservation_id='r-3xgua6lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-205046583',owner_user_name='tempest-ServerStableDeviceRescueTest-205046583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='289e367da4e444a791a556dafb7ec392',uuid=69ed2396-a603-4c84-a66b-7b474523b68e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Converting VIF {"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:13:99,bridge_name='br-int',has_traffic_filtering=True,id=0502d8bd-666e-4f27-8c38-e060b44ce264,network=Network(0cce3e7a-230f-426f-9807-14feb9122e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0502d8bd-66') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.objects.instance [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lazy-loading 'pci_devices' on Instance uuid 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:54:20 user nova-compute[75113]:   <uuid>69ed2396-a603-4c84-a66b-7b474523b68e</uuid>
Oct 26 16:54:20 user nova-compute[75113]:   <name>instance-00000003</name>
Oct 26 16:54:20 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:54:20 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:54:20 user nova-compute[75113]:   <metadata>
Oct 26 16:54:20 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:54:20 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:54:20 user nova-compute[75113]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1913117266</nova:name>
Oct 26 16:54:20 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:54:20</nova:creationTime>
Oct 26 16:54:20 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:54:20 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:54:20 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:54:20 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:54:20 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:54:20 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:54:20 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:54:20 user nova-compute[75113]:       <nova:owner>
Oct 26 16:54:20 user nova-compute[75113]:         <nova:user uuid="289e367da4e444a791a556dafb7ec392">tempest-ServerStableDeviceRescueTest-205046583-project-member</nova:user>
Oct 26 16:54:20 user nova-compute[75113]:         <nova:project uuid="992dea425f6241c2b94c1a1c970cb028">tempest-ServerStableDeviceRescueTest-205046583</nova:project>
Oct 26 16:54:20 user nova-compute[75113]:       </nova:owner>
Oct 26 16:54:20 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:54:20 user nova-compute[75113]:       <nova:ports>
Oct 26 16:54:20 user nova-compute[75113]:         <nova:port uuid="0502d8bd-666e-4f27-8c38-e060b44ce264">
Oct 26 16:54:20 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 16:54:20 user nova-compute[75113]:         </nova:port>
Oct 26 16:54:20 user nova-compute[75113]:       </nova:ports>
Oct 26 16:54:20 user nova-compute[75113]:     </nova:instance>
Oct 26 16:54:20 user nova-compute[75113]:   </metadata>
Oct 26 16:54:20 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:54:20 user nova-compute[75113]:     <system>
Oct 26 16:54:20 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:54:20 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:54:20 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:54:20 user nova-compute[75113]:       <entry name="serial">69ed2396-a603-4c84-a66b-7b474523b68e</entry>
Oct 26 16:54:20 user nova-compute[75113]:       <entry name="uuid">69ed2396-a603-4c84-a66b-7b474523b68e</entry>
Oct 26 16:54:20 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:54:20 user nova-compute[75113]:     </system>
Oct 26 16:54:20 user nova-compute[75113]:   </sysinfo>
Oct 26 16:54:20 user nova-compute[75113]:   <os>
Oct 26 16:54:20 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:54:20 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:54:20 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:54:20 user nova-compute[75113]:   </os>
Oct 26 16:54:20 user nova-compute[75113]:   <features>
Oct 26 16:54:20 user nova-compute[75113]:     <acpi/>
Oct 26 16:54:20 user nova-compute[75113]:     <apic/>
Oct 26 16:54:20 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:54:20 user nova-compute[75113]:   </features>
Oct 26 16:54:20 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:54:20 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:54:20 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:54:20 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:54:20 user nova-compute[75113]:   </clock>
Oct 26 16:54:20 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:54:20 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:54:20 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:54:20 user nova-compute[75113]:   </cpu>
Oct 26 16:54:20 user nova-compute[75113]:   <devices>
Oct 26 16:54:20 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:54:20 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:54:20 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk"/>
Oct 26 16:54:20 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:54:20 user nova-compute[75113]:     </disk>
Oct 26 16:54:20 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:54:20 user nova-compute[75113]:       <mac address="fa:16:3e:bf:13:99"/>
Oct 26 16:54:20 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:20 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:54:20 user nova-compute[75113]:       <target dev="tap0502d8bd-66"/>
Oct 26 16:54:20 user nova-compute[75113]:     </interface>
Oct 26 16:54:20 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:54:20 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/console.log" append="off"/>
Oct 26 16:54:20 user nova-compute[75113]:     </serial>
Oct 26 16:54:20 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:54:20 user nova-compute[75113]:     <video>
Oct 26 16:54:20 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:20 user nova-compute[75113]:     </video>
Oct 26 16:54:20 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:54:20 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:54:20 user nova-compute[75113]:     </rng>
Oct 26 16:54:20 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:54:20 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:54:20 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:54:20 user nova-compute[75113]:     </memballoon>
Oct 26 16:54:20 user nova-compute[75113]:   </devices>
Oct 26 16:54:20 user nova-compute[75113]: </domain>
Oct 26 16:54:20 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1913117266',display_name='tempest-ServerStableDeviceRescueTest-server-1913117266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1913117266',id=3,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW+UVAaeZhsHcgJPMCTV2xrTl4CNLS+MkerMjXHgsZ/82ki6sNGkNDlnGa3RyBILee0xpxEsN4D9jct3D9FBDbCeR7Aa5wxdczxapjdNt9OslE9CMc4aivD8gDSXppcbA==',key_name='tempest-keypair-522693316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='992dea425f6241c2b94c1a1c970cb028',ramdisk_id='',reservation_id='r-3xgua6lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-205046583',owner_user_name='tempest-ServerStableDeviceRescueTest-205046583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='289e367da4e444a791a556dafb7ec392',uuid=69ed2396-a603-4c84-a66b-7b474523b68e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Converting VIF {"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:13:99,bridge_name='br-int',has_traffic_filtering=True,id=0502d8bd-666e-4f27-8c38-e060b44ce264,network=Network(0cce3e7a-230f-426f-9807-14feb9122e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0502d8bd-66') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG os_vif [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:13:99,bridge_name='br-int',has_traffic_filtering=True,id=0502d8bd-666e-4f27-8c38-e060b44ce264,network=Network(0cce3e7a-230f-426f-9807-14feb9122e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0502d8bd-66') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91a9b3ac-5bc1-5568-b312-2eee79a7ec18', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0502d8bd-66, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0502d8bd-66, col_values=(('qos', UUID('22ee2a65-a93f-4687-b2fe-d4757e925358')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0502d8bd-66, col_values=(('external_ids', {'iface-id': '0502d8bd-666e-4f27-8c38-e060b44ce264', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:13:99', 'vm-uuid': '69ed2396-a603-4c84-a66b-7b474523b68e'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:20 user nova-compute[75113]: INFO os_vif [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:13:99,bridge_name='br-int',has_traffic_filtering=True,id=0502d8bd-666e-4f27-8c38-e060b44ce264,network=Network(0cce3e7a-230f-426f-9807-14feb9122e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0502d8bd-66')
Oct 26 16:54:20 user nova-compute[75113]: INFO nova.compute.manager [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Took 14.06 seconds to build instance.
Oct 26 16:54:20 user nova-compute[75113]: INFO nova.compute.manager [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Took 14.73 seconds to spawn the instance on the hypervisor.
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3989cd6f-6e87-466e-a046-825eca37f288 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.238s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:54:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] No VIF found with MAC fa:16:3e:bf:13:99, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:54:20 user nova-compute[75113]: INFO nova.compute.manager [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Took 16.09 seconds to build instance.
Oct 26 16:54:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8362f231-4087-4a98-b12b-37663f2ad0bd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.332s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:21 user nova-compute[75113]: DEBUG nova.network.neutron [req-e33113f5-a9a7-41bf-838c-aad3f6b5f63c req-5dc82b8f-76f3-4f5e-8fbd-6e847c4455d9 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updated VIF entry in instance network info cache for port 0502d8bd-666e-4f27-8c38-e060b44ce264. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:54:21 user nova-compute[75113]: DEBUG nova.network.neutron [req-e33113f5-a9a7-41bf-838c-aad3f6b5f63c req-5dc82b8f-76f3-4f5e-8fbd-6e847c4455d9 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updating instance_info_cache with network_info: [{"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e33113f5-a9a7-41bf-838c-aad3f6b5f63c req-5dc82b8f-76f3-4f5e-8fbd-6e847c4455d9 service nova] Releasing lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:54:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:54:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:25 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Instance spawned successfully.
Oct 26 16:54:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:54:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:25 user nova-compute[75113]: INFO nova.compute.manager [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Took 15.48 seconds to spawn the instance on the hypervisor.
Oct 26 16:54:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:54:25 user nova-compute[75113]: INFO nova.compute.manager [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Took 16.71 seconds to build instance.
Oct 26 16:54:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c072cf42-62e6-439a-9e3d-7a0590dedc71 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "69ed2396-a603-4c84-a66b-7b474523b68e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.916s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-b4b3ecf7-9443-48f4-8e11-392072d0de73 req-370d5caa-a51a-4bb5-a95d-a13d4124cf15 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b3ecf7-9443-48f4-8e11-392072d0de73 req-370d5caa-a51a-4bb5-a95d-a13d4124cf15 service nova] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b3ecf7-9443-48f4-8e11-392072d0de73 req-370d5caa-a51a-4bb5-a95d-a13d4124cf15 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b3ecf7-9443-48f4-8e11-392072d0de73 req-370d5caa-a51a-4bb5-a95d-a13d4124cf15 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-b4b3ecf7-9443-48f4-8e11-392072d0de73 req-370d5caa-a51a-4bb5-a95d-a13d4124cf15 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] No waiting events found dispatching network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:27 user nova-compute[75113]: WARNING nova.compute.manager [req-b4b3ecf7-9443-48f4-8e11-392072d0de73 req-370d5caa-a51a-4bb5-a95d-a13d4124cf15 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received unexpected event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 for instance with vm_state active and task_state None.
Oct 26 16:54:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "f1769d95-897b-4e83-89ba-c486aa086dc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:28 user nova-compute[75113]: DEBUG nova.compute.manager [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:54:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:54:28 user nova-compute[75113]: INFO nova.compute.claims [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Claim successful on node user
Oct 26 16:54:28 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG nova.compute.manager [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG nova.compute.manager [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG nova.network.neutron [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:54:29 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:54:29 user nova-compute[75113]: DEBUG nova.compute.manager [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG nova.compute.manager [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:54:29 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Creating image(s)
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "/opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "/opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG nova.policy [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9ca04a69e784bc38c31b5ca256d3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ee9d2be45d4517a2cfea00177b1c15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-cc3fd68a-fc2c-4e22-90c7-2e4f3bb5a5c5 req-5e12cd91-e878-4f6d-8329-80c07b16c6b2 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cc3fd68a-fc2c-4e22-90c7-2e4f3bb5a5c5 req-5e12cd91-e878-4f6d-8329-80c07b16c6b2 service nova] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cc3fd68a-fc2c-4e22-90c7-2e4f3bb5a5c5 req-5e12cd91-e878-4f6d-8329-80c07b16c6b2 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cc3fd68a-fc2c-4e22-90c7-2e4f3bb5a5c5 req-5e12cd91-e878-4f6d-8329-80c07b16c6b2 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-cc3fd68a-fc2c-4e22-90c7-2e4f3bb5a5c5 req-5e12cd91-e878-4f6d-8329-80c07b16c6b2 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] No waiting events found dispatching network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:29 user nova-compute[75113]: WARNING nova.compute.manager [req-cc3fd68a-fc2c-4e22-90c7-2e4f3bb5a5c5 req-5e12cd91-e878-4f6d-8329-80c07b16c6b2 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received unexpected event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 for instance with vm_state active and task_state None.
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.225s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.277s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk 1073741824" returned: 0 in 0.081s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.368s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.246s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Cannot resize image /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Ensure instance console log exists: /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.007s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:31 user nova-compute[75113]: DEBUG nova.network.neutron [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Successfully created port: 8af075bf-d8dd-478d-9f83-3faf420bc6c6 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG nova.network.neutron [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Successfully updated port: 8af075bf-d8dd-478d-9f83-3faf420bc6c6 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "refresh_cache-f1769d95-897b-4e83-89ba-c486aa086dc1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquired lock "refresh_cache-f1769d95-897b-4e83-89ba-c486aa086dc1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG nova.network.neutron [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG nova.compute.manager [req-62cb52d4-6f75-4a85-b10d-02679df80327 req-01cd8094-e75d-46a9-a31d-2342441b5698 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Received event network-changed-8af075bf-d8dd-478d-9f83-3faf420bc6c6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG nova.compute.manager [req-62cb52d4-6f75-4a85-b10d-02679df80327 req-01cd8094-e75d-46a9-a31d-2342441b5698 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Refreshing instance network info cache due to event network-changed-8af075bf-d8dd-478d-9f83-3faf420bc6c6. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-62cb52d4-6f75-4a85-b10d-02679df80327 req-01cd8094-e75d-46a9-a31d-2342441b5698 service nova] Acquiring lock "refresh_cache-f1769d95-897b-4e83-89ba-c486aa086dc1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG nova.network.neutron [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "af957c0b-a655-4b55-974a-70256a760d3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "af957c0b-a655-4b55-974a-70256a760d3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:54:32 user nova-compute[75113]: INFO nova.compute.claims [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Claim successful on node user
Oct 26 16:54:32 user nova-compute[75113]: DEBUG nova.network.neutron [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Updating instance_info_cache with network_info: [{"id": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "address": "fa:16:3e:54:a8:27", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af075bf-d8", "ovs_interfaceid": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Releasing lock "refresh_cache-f1769d95-897b-4e83-89ba-c486aa086dc1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG nova.compute.manager [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Instance network_info: |[{"id": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "address": "fa:16:3e:54:a8:27", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af075bf-d8", "ovs_interfaceid": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-62cb52d4-6f75-4a85-b10d-02679df80327 req-01cd8094-e75d-46a9-a31d-2342441b5698 service nova] Acquired lock "refresh_cache-f1769d95-897b-4e83-89ba-c486aa086dc1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG nova.network.neutron [req-62cb52d4-6f75-4a85-b10d-02679df80327 req-01cd8094-e75d-46a9-a31d-2342441b5698 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Refreshing network info cache for port 8af075bf-d8dd-478d-9f83-3faf420bc6c6 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Start _get_guest_xml network_info=[{"id": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "address": "fa:16:3e:54:a8:27", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af075bf-d8", "ovs_interfaceid": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:54:32 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:32 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:54:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1556194533',display_name='tempest-VolumesAdminNegativeTest-server-1556194533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1556194533',id=4,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmZFeWrEnHR9BsSaIACkxRo9vJSoEocr4pXNFSOhDA84ka5b4vV0OYnGZ1ugAGWwLgRH1P/JMK832RdxTsXk1ZQsF72seCCUk/Lf3tBAzMyjy/8h6VFWg5DeT03DpfQHQ==',key_name='tempest-keypair-1355933924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66ee9d2be45d4517a2cfea00177b1c15',ramdisk_id='',reservation_id='r-mxu9sz7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1147285819',owner_user_name='tempest-VolumesAdminNegativeTest-1147285819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9ca04a69e784bc38c31b5ca256d3a94',uuid=f1769d95-897b-4e83-89ba-c486aa086dc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "address": "fa:16:3e:54:a8:27", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af075bf-d8", "ovs_interfaceid": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Converting VIF {"id": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "address": "fa:16:3e:54:a8:27", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af075bf-d8", "ovs_interfaceid": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:a8:27,bridge_name='br-int',has_traffic_filtering=True,id=8af075bf-d8dd-478d-9f83-3faf420bc6c6,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8af075bf-d8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.objects.instance [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lazy-loading 'pci_devices' on Instance uuid f1769d95-897b-4e83-89ba-c486aa086dc1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:54:33 user nova-compute[75113]:   <uuid>f1769d95-897b-4e83-89ba-c486aa086dc1</uuid>
Oct 26 16:54:33 user nova-compute[75113]:   <name>instance-00000004</name>
Oct 26 16:54:33 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:54:33 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:54:33 user nova-compute[75113]:   <metadata>
Oct 26 16:54:33 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:54:33 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:54:33 user nova-compute[75113]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1556194533</nova:name>
Oct 26 16:54:33 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:54:32</nova:creationTime>
Oct 26 16:54:33 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:54:33 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:54:33 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:54:33 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:54:33 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:54:33 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:54:33 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:54:33 user nova-compute[75113]:       <nova:owner>
Oct 26 16:54:33 user nova-compute[75113]:         <nova:user uuid="f9ca04a69e784bc38c31b5ca256d3a94">tempest-VolumesAdminNegativeTest-1147285819-project-member</nova:user>
Oct 26 16:54:33 user nova-compute[75113]:         <nova:project uuid="66ee9d2be45d4517a2cfea00177b1c15">tempest-VolumesAdminNegativeTest-1147285819</nova:project>
Oct 26 16:54:33 user nova-compute[75113]:       </nova:owner>
Oct 26 16:54:33 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:54:33 user nova-compute[75113]:       <nova:ports>
Oct 26 16:54:33 user nova-compute[75113]:         <nova:port uuid="8af075bf-d8dd-478d-9f83-3faf420bc6c6">
Oct 26 16:54:33 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 16:54:33 user nova-compute[75113]:         </nova:port>
Oct 26 16:54:33 user nova-compute[75113]:       </nova:ports>
Oct 26 16:54:33 user nova-compute[75113]:     </nova:instance>
Oct 26 16:54:33 user nova-compute[75113]:   </metadata>
Oct 26 16:54:33 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:54:33 user nova-compute[75113]:     <system>
Oct 26 16:54:33 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:54:33 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:54:33 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:54:33 user nova-compute[75113]:       <entry name="serial">f1769d95-897b-4e83-89ba-c486aa086dc1</entry>
Oct 26 16:54:33 user nova-compute[75113]:       <entry name="uuid">f1769d95-897b-4e83-89ba-c486aa086dc1</entry>
Oct 26 16:54:33 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:54:33 user nova-compute[75113]:     </system>
Oct 26 16:54:33 user nova-compute[75113]:   </sysinfo>
Oct 26 16:54:33 user nova-compute[75113]:   <os>
Oct 26 16:54:33 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:54:33 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:54:33 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:54:33 user nova-compute[75113]:   </os>
Oct 26 16:54:33 user nova-compute[75113]:   <features>
Oct 26 16:54:33 user nova-compute[75113]:     <acpi/>
Oct 26 16:54:33 user nova-compute[75113]:     <apic/>
Oct 26 16:54:33 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:54:33 user nova-compute[75113]:   </features>
Oct 26 16:54:33 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:54:33 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:54:33 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:54:33 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:54:33 user nova-compute[75113]:   </clock>
Oct 26 16:54:33 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:54:33 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:54:33 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:54:33 user nova-compute[75113]:   </cpu>
Oct 26 16:54:33 user nova-compute[75113]:   <devices>
Oct 26 16:54:33 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:54:33 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:54:33 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk"/>
Oct 26 16:54:33 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:54:33 user nova-compute[75113]:     </disk>
Oct 26 16:54:33 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:54:33 user nova-compute[75113]:       <mac address="fa:16:3e:54:a8:27"/>
Oct 26 16:54:33 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:33 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:54:33 user nova-compute[75113]:       <target dev="tap8af075bf-d8"/>
Oct 26 16:54:33 user nova-compute[75113]:     </interface>
Oct 26 16:54:33 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:54:33 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/console.log" append="off"/>
Oct 26 16:54:33 user nova-compute[75113]:     </serial>
Oct 26 16:54:33 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:54:33 user nova-compute[75113]:     <video>
Oct 26 16:54:33 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:33 user nova-compute[75113]:     </video>
Oct 26 16:54:33 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:54:33 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:54:33 user nova-compute[75113]:     </rng>
Oct 26 16:54:33 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:54:33 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:54:33 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:54:33 user nova-compute[75113]:     </memballoon>
Oct 26 16:54:33 user nova-compute[75113]:   </devices>
Oct 26 16:54:33 user nova-compute[75113]: </domain>
Oct 26 16:54:33 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1556194533',display_name='tempest-VolumesAdminNegativeTest-server-1556194533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1556194533',id=4,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmZFeWrEnHR9BsSaIACkxRo9vJSoEocr4pXNFSOhDA84ka5b4vV0OYnGZ1ugAGWwLgRH1P/JMK832RdxTsXk1ZQsF72seCCUk/Lf3tBAzMyjy/8h6VFWg5DeT03DpfQHQ==',key_name='tempest-keypair-1355933924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66ee9d2be45d4517a2cfea00177b1c15',ramdisk_id='',reservation_id='r-mxu9sz7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1147285819',owner_user_name='tempest-VolumesAdminNegativeTest-1147285819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9ca04a69e784bc38c31b5ca256d3a94',uuid=f1769d95-897b-4e83-89ba-c486aa086dc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "address": "fa:16:3e:54:a8:27", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af075bf-d8", "ovs_interfaceid": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Converting VIF {"id": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "address": "fa:16:3e:54:a8:27", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af075bf-d8", "ovs_interfaceid": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:a8:27,bridge_name='br-int',has_traffic_filtering=True,id=8af075bf-d8dd-478d-9f83-3faf420bc6c6,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8af075bf-d8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG os_vif [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:a8:27,bridge_name='br-int',has_traffic_filtering=True,id=8af075bf-d8dd-478d-9f83-3faf420bc6c6,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8af075bf-d8') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf73dff2-80e1-56ee-8b3f-299d50080c91', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8af075bf-d8, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8af075bf-d8, col_values=(('qos', UUID('cbdb1d23-d797-4f78-b8ac-c476ecddbc26')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8af075bf-d8, col_values=(('external_ids', {'iface-id': '8af075bf-d8dd-478d-9f83-3faf420bc6c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:a8:27', 'vm-uuid': 'f1769d95-897b-4e83-89ba-c486aa086dc1'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:33 user nova-compute[75113]: INFO os_vif [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:a8:27,bridge_name='br-int',has_traffic_filtering=True,id=8af075bf-d8dd-478d-9f83-3faf420bc6c6,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8af075bf-d8')
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] No VIF found with MAC fa:16:3e:54:a8:27, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.network.neutron [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:54:33 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.policy [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1e946a8fbdc4a03b4ea92a6625eaf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17a0645348045aa82d80f7291a44d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:54:33 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Creating image(s)
Oct 26 16:54:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "/opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "/opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "/opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "6f6d6eb50369a0517a349d38cc7275b24c19d56e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "6f6d6eb50369a0517a349d38cc7275b24c19d56e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e.part --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:34 user nova-compute[75113]: DEBUG nova.network.neutron [req-62cb52d4-6f75-4a85-b10d-02679df80327 req-01cd8094-e75d-46a9-a31d-2342441b5698 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Updated VIF entry in instance network info cache for port 8af075bf-d8dd-478d-9f83-3faf420bc6c6. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:54:34 user nova-compute[75113]: DEBUG nova.network.neutron [req-62cb52d4-6f75-4a85-b10d-02679df80327 req-01cd8094-e75d-46a9-a31d-2342441b5698 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Updating instance_info_cache with network_info: [{"id": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "address": "fa:16:3e:54:a8:27", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af075bf-d8", "ovs_interfaceid": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-62cb52d4-6f75-4a85-b10d-02679df80327 req-01cd8094-e75d-46a9-a31d-2342441b5698 service nova] Releasing lock "refresh_cache-f1769d95-897b-4e83-89ba-c486aa086dc1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e.part --force-share --output=json" returned: 0 in 0.244s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:34 user nova-compute[75113]: DEBUG nova.virt.images [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] cc1f1336-ef01-47e1-90f2-25afaf721b82 was qcow2, converting to raw {{(pid=75113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 16:54:34 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 16:54:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e.part /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e.converted {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e.part /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e.converted" returned: 0 in 0.378s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e.converted --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e.converted --force-share --output=json" returned: 0 in 0.327s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "6f6d6eb50369a0517a349d38cc7275b24c19d56e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.529s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG nova.network.neutron [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Successfully created port: 39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG nova.compute.manager [req-cdb3d751-1aa0-42d0-b50c-f4711c1e3a74 req-b55a38d2-d8d9-4d78-bf9f-16e570fdf1d4 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Received event network-vif-plugged-c66a2219-e937-4d6b-8c1c-275d9f4ee094 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cdb3d751-1aa0-42d0-b50c-f4711c1e3a74 req-b55a38d2-d8d9-4d78-bf9f-16e570fdf1d4 service nova] Acquiring lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cdb3d751-1aa0-42d0-b50c-f4711c1e3a74 req-b55a38d2-d8d9-4d78-bf9f-16e570fdf1d4 service nova] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cdb3d751-1aa0-42d0-b50c-f4711c1e3a74 req-b55a38d2-d8d9-4d78-bf9f-16e570fdf1d4 service nova] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG nova.compute.manager [req-cdb3d751-1aa0-42d0-b50c-f4711c1e3a74 req-b55a38d2-d8d9-4d78-bf9f-16e570fdf1d4 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] No waiting events found dispatching network-vif-plugged-c66a2219-e937-4d6b-8c1c-275d9f4ee094 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:35 user nova-compute[75113]: WARNING nova.compute.manager [req-cdb3d751-1aa0-42d0-b50c-f4711c1e3a74 req-b55a38d2-d8d9-4d78-bf9f-16e570fdf1d4 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Received unexpected event network-vif-plugged-c66a2219-e937-4d6b-8c1c-275d9f4ee094 for instance with vm_state active and task_state None.
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:54:35 user nova-compute[75113]: INFO nova.compute.claims [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Claim successful on node user
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e --force-share --output=json" returned: 0 in 0.287s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "6f6d6eb50369a0517a349d38cc7275b24c19d56e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "6f6d6eb50369a0517a349d38cc7275b24c19d56e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e --force-share --output=json" returned: 0 in 0.234s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e,backing_fmt=raw /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e,backing_fmt=raw /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk 1073741824" returned: 0 in 0.097s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "6f6d6eb50369a0517a349d38cc7275b24c19d56e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f6d6eb50369a0517a349d38cc7275b24c19d56e --force-share --output=json" returned: 0 in 0.277s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.803s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:54:36 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Acquiring lock "e632e8ad-6d44-4a57-a04b-342bdf513260" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Cannot resize image /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Ensure instance console log exists: /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.policy [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7cbd5018fe6453095388366e914a5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee6a73f02e54d7fa20bbe92d986f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:54:36 user nova-compute[75113]: INFO nova.compute.claims [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Claim successful on node user
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:54:36 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Creating image(s)
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "/opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "/opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.network.neutron [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Successfully updated port: 39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-a1c1897d-b480-4b80-b3df-c0cc800e23b5 req-d7d3d0f8-fda5-46aa-8372-b7d08d3a216a service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Received event network-changed-39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-a1c1897d-b480-4b80-b3df-c0cc800e23b5 req-d7d3d0f8-fda5-46aa-8372-b7d08d3a216a service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Refreshing instance network info cache due to event network-changed-39dbc0a5-bfeb-47fc-993b-06de27422f03. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a1c1897d-b480-4b80-b3df-c0cc800e23b5 req-d7d3d0f8-fda5-46aa-8372-b7d08d3a216a service nova] Acquiring lock "refresh_cache-af957c0b-a655-4b55-974a-70256a760d3c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a1c1897d-b480-4b80-b3df-c0cc800e23b5 req-d7d3d0f8-fda5-46aa-8372-b7d08d3a216a service nova] Acquired lock "refresh_cache-af957c0b-a655-4b55-974a-70256a760d3c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG nova.network.neutron [req-a1c1897d-b480-4b80-b3df-c0cc800e23b5 req-d7d3d0f8-fda5-46aa-8372-b7d08d3a216a service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Refreshing network info cache for port 39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:54:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "refresh_cache-af957c0b-a655-4b55-974a-70256a760d3c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.225s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.network.neutron [req-a1c1897d-b480-4b80-b3df-c0cc800e23b5 req-d7d3d0f8-fda5-46aa-8372-b7d08d3a216a service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.278s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.700s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk 1073741824" returned: 0 in 0.063s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.network.neutron [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.compute.manager [req-e5b873af-57d9-4e26-aad9-2aa072329726 req-91eb8c78-58bf-4f06-ad81-8bc1915e40ee service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Received event network-vif-plugged-c66a2219-e937-4d6b-8c1c-275d9f4ee094 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e5b873af-57d9-4e26-aad9-2aa072329726 req-91eb8c78-58bf-4f06-ad81-8bc1915e40ee service nova] Acquiring lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e5b873af-57d9-4e26-aad9-2aa072329726 req-91eb8c78-58bf-4f06-ad81-8bc1915e40ee service nova] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e5b873af-57d9-4e26-aad9-2aa072329726 req-91eb8c78-58bf-4f06-ad81-8bc1915e40ee service nova] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.compute.manager [req-e5b873af-57d9-4e26-aad9-2aa072329726 req-91eb8c78-58bf-4f06-ad81-8bc1915e40ee service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] No waiting events found dispatching network-vif-plugged-c66a2219-e937-4d6b-8c1c-275d9f4ee094 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:37 user nova-compute[75113]: WARNING nova.compute.manager [req-e5b873af-57d9-4e26-aad9-2aa072329726 req-91eb8c78-58bf-4f06-ad81-8bc1915e40ee service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Received unexpected event network-vif-plugged-c66a2219-e937-4d6b-8c1c-275d9f4ee094 for instance with vm_state active and task_state None.
Oct 26 16:54:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.policy [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1933ebb859b64f4f95374d9ef8948ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154d6bc4a64448cba3150f04e0d5834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.373s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:54:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Instance spawned successfully.
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:54:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Creating image(s)
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Acquiring lock "/opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "/opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "/opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.network.neutron [req-a1c1897d-b480-4b80-b3df-c0cc800e23b5 req-d7d3d0f8-fda5-46aa-8372-b7d08d3a216a service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a1c1897d-b480-4b80-b3df-c0cc800e23b5 req-d7d3d0f8-fda5-46aa-8372-b7d08d3a216a service nova] Releasing lock "refresh_cache-af957c0b-a655-4b55-974a-70256a760d3c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquired lock "refresh_cache-af957c0b-a655-4b55-974a-70256a760d3c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Cannot resize image /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Ensure instance console log exists: /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:38 user nova-compute[75113]: INFO nova.compute.manager [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Took 8.62 seconds to spawn the instance on the hypervisor.
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.compute.manager [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Successfully created port: 02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:54:38 user nova-compute[75113]: INFO nova.compute.manager [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Took 9.78 seconds to build instance.
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.236s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-57b9380c-cf41-4ec5-9b4b-638010b38674 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.023s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.261s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk 1073741824" returned: 0 in 0.092s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.359s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Successfully created port: 3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Updating instance_info_cache with network_info: [{"id": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "address": "fa:16:3e:8a:91:a9", "network": {"id": "c18bc66f-1d7e-41b4-b583-fce9e5d78cd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1141220283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17a0645348045aa82d80f7291a44d3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39dbc0a5-bf", "ovs_interfaceid": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Releasing lock "refresh_cache-af957c0b-a655-4b55-974a-70256a760d3c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Instance network_info: |[{"id": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "address": "fa:16:3e:8a:91:a9", "network": {"id": "c18bc66f-1d7e-41b4-b583-fce9e5d78cd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1141220283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17a0645348045aa82d80f7291a44d3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39dbc0a5-bf", "ovs_interfaceid": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Start _get_guest_xml network_info=[{"id": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "address": "fa:16:3e:8a:91:a9", "network": {"id": "c18bc66f-1d7e-41b4-b583-fce9e5d78cd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1141220283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17a0645348045aa82d80f7291a44d3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39dbc0a5-bf", "ovs_interfaceid": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:54:23Z,direct_url=<?>,disk_format='qcow2',id=cc1f1336-ef01-47e1-90f2-25afaf721b82,min_disk=0,min_ram=0,name='',owner='50dd6361f67e48138f06759fc7d62c88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:54:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/sda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'scsi', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'cc1f1336-ef01-47e1-90f2-25afaf721b82'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:54:38 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:38 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:54:23Z,direct_url=<?>,disk_format='qcow2',id=cc1f1336-ef01-47e1-90f2-25afaf721b82,min_disk=0,min_ram=0,name='',owner='50dd6361f67e48138f06759fc7d62c88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:54:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1426482460',display_name='tempest-AttachSCSIVolumeTestJSON-server-1426482460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1426482460',id=5,image_ref='cc1f1336-ef01-47e1-90f2-25afaf721b82',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0K28/2i+M3UmaIYAKYzesmqLzym/PUmV55xe9Lo8DFBRg1Pe6l5b8hBe4JpEyk1G2LHOlJXiXSZ8FGlfp45/x8bNO+s/pXJcZaHArKZia52ZX1WbUya0RUqlrQpLjyXA==',key_name='tempest-keypair-1204517582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17a0645348045aa82d80f7291a44d3c',ramdisk_id='',reservation_id='r-p2e7dfma',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cc1f1336-ef01-47e1-90f2-25afaf721b82',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-372264898',owner_user_name='tempest-AttachSCSIVolumeTestJSON-372264898-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1e946a8fbdc4a03b4ea92a6625eaf76',uuid=af957c0b-a655-4b55-974a-70256a760d3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "address": "fa:16:3e:8a:91:a9", "network": {"id": "c18bc66f-1d7e-41b4-b583-fce9e5d78cd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1141220283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17a0645348045aa82d80f7291a44d3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39dbc0a5-bf", "ovs_interfaceid": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Converting VIF {"id": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "address": "fa:16:3e:8a:91:a9", "network": {"id": "c18bc66f-1d7e-41b4-b583-fce9e5d78cd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1141220283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17a0645348045aa82d80f7291a44d3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39dbc0a5-bf", "ovs_interfaceid": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:91:a9,bridge_name='br-int',has_traffic_filtering=True,id=39dbc0a5-bfeb-47fc-993b-06de27422f03,network=Network(c18bc66f-1d7e-41b4-b583-fce9e5d78cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39dbc0a5-bf') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.objects.instance [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lazy-loading 'pci_devices' on Instance uuid af957c0b-a655-4b55-974a-70256a760d3c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.376s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:54:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:54:39 user nova-compute[75113]:   <uuid>af957c0b-a655-4b55-974a-70256a760d3c</uuid>
Oct 26 16:54:39 user nova-compute[75113]:   <name>instance-00000005</name>
Oct 26 16:54:39 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:54:39 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:54:39 user nova-compute[75113]:   <metadata>
Oct 26 16:54:39 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:54:39 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:54:39 user nova-compute[75113]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1426482460</nova:name>
Oct 26 16:54:39 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:54:38</nova:creationTime>
Oct 26 16:54:39 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:54:39 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:54:39 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:54:39 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:54:39 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:54:39 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:54:39 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:54:39 user nova-compute[75113]:       <nova:owner>
Oct 26 16:54:39 user nova-compute[75113]:         <nova:user uuid="c1e946a8fbdc4a03b4ea92a6625eaf76">tempest-AttachSCSIVolumeTestJSON-372264898-project-member</nova:user>
Oct 26 16:54:39 user nova-compute[75113]:         <nova:project uuid="c17a0645348045aa82d80f7291a44d3c">tempest-AttachSCSIVolumeTestJSON-372264898</nova:project>
Oct 26 16:54:39 user nova-compute[75113]:       </nova:owner>
Oct 26 16:54:39 user nova-compute[75113]:       <nova:root type="image" uuid="cc1f1336-ef01-47e1-90f2-25afaf721b82"/>
Oct 26 16:54:39 user nova-compute[75113]:       <nova:ports>
Oct 26 16:54:39 user nova-compute[75113]:         <nova:port uuid="39dbc0a5-bfeb-47fc-993b-06de27422f03">
Oct 26 16:54:39 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 16:54:39 user nova-compute[75113]:         </nova:port>
Oct 26 16:54:39 user nova-compute[75113]:       </nova:ports>
Oct 26 16:54:39 user nova-compute[75113]:     </nova:instance>
Oct 26 16:54:39 user nova-compute[75113]:   </metadata>
Oct 26 16:54:39 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:54:39 user nova-compute[75113]:     <system>
Oct 26 16:54:39 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:54:39 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:54:39 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:54:39 user nova-compute[75113]:       <entry name="serial">af957c0b-a655-4b55-974a-70256a760d3c</entry>
Oct 26 16:54:39 user nova-compute[75113]:       <entry name="uuid">af957c0b-a655-4b55-974a-70256a760d3c</entry>
Oct 26 16:54:39 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:54:39 user nova-compute[75113]:     </system>
Oct 26 16:54:39 user nova-compute[75113]:   </sysinfo>
Oct 26 16:54:39 user nova-compute[75113]:   <os>
Oct 26 16:54:39 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:54:39 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:54:39 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:54:39 user nova-compute[75113]:   </os>
Oct 26 16:54:39 user nova-compute[75113]:   <features>
Oct 26 16:54:39 user nova-compute[75113]:     <acpi/>
Oct 26 16:54:39 user nova-compute[75113]:     <apic/>
Oct 26 16:54:39 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:54:39 user nova-compute[75113]:   </features>
Oct 26 16:54:39 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:54:39 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:54:39 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:54:39 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:54:39 user nova-compute[75113]:   </clock>
Oct 26 16:54:39 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:54:39 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:54:39 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:54:39 user nova-compute[75113]:   </cpu>
Oct 26 16:54:39 user nova-compute[75113]:   <devices>
Oct 26 16:54:39 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:54:39 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:54:39 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk"/>
Oct 26 16:54:39 user nova-compute[75113]:       <target dev="sda" bus="scsi"/>
Oct 26 16:54:39 user nova-compute[75113]:       <address type="drive" controller="0" unit="0"/>
Oct 26 16:54:39 user nova-compute[75113]:     </disk>
Oct 26 16:54:39 user nova-compute[75113]:     <disk type="file" device="cdrom">
Oct 26 16:54:39 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 16:54:39 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk.config"/>
Oct 26 16:54:39 user nova-compute[75113]:       <target dev="sdb" bus="scsi"/>
Oct 26 16:54:39 user nova-compute[75113]:       <address type="drive" controller="0" unit="1"/>
Oct 26 16:54:39 user nova-compute[75113]:     </disk>
Oct 26 16:54:39 user nova-compute[75113]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 26 16:54:39 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:54:39 user nova-compute[75113]:       <mac address="fa:16:3e:8a:91:a9"/>
Oct 26 16:54:39 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:39 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:54:39 user nova-compute[75113]:       <target dev="tap39dbc0a5-bf"/>
Oct 26 16:54:39 user nova-compute[75113]:     </interface>
Oct 26 16:54:39 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:54:39 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/console.log" append="off"/>
Oct 26 16:54:39 user nova-compute[75113]:     </serial>
Oct 26 16:54:39 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:54:39 user nova-compute[75113]:     <video>
Oct 26 16:54:39 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:39 user nova-compute[75113]:     </video>
Oct 26 16:54:39 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:54:39 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:54:39 user nova-compute[75113]:     </rng>
Oct 26 16:54:39 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:54:39 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:54:39 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:54:39 user nova-compute[75113]:     </memballoon>
Oct 26 16:54:39 user nova-compute[75113]:   </devices>
Oct 26 16:54:39 user nova-compute[75113]: </domain>
Oct 26 16:54:39 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1426482460',display_name='tempest-AttachSCSIVolumeTestJSON-server-1426482460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1426482460',id=5,image_ref='cc1f1336-ef01-47e1-90f2-25afaf721b82',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0K28/2i+M3UmaIYAKYzesmqLzym/PUmV55xe9Lo8DFBRg1Pe6l5b8hBe4JpEyk1G2LHOlJXiXSZ8FGlfp45/x8bNO+s/pXJcZaHArKZia52ZX1WbUya0RUqlrQpLjyXA==',key_name='tempest-keypair-1204517582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17a0645348045aa82d80f7291a44d3c',ramdisk_id='',reservation_id='r-p2e7dfma',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cc1f1336-ef01-47e1-90f2-25afaf721b82',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-372264898',owner_user_name='tempest-AttachSCSIVolumeTestJSON-372264898-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1e946a8fbdc4a03b4ea92a6625eaf76',uuid=af957c0b-a655-4b55-974a-70256a760d3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "address": "fa:16:3e:8a:91:a9", "network": {"id": "c18bc66f-1d7e-41b4-b583-fce9e5d78cd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1141220283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17a0645348045aa82d80f7291a44d3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39dbc0a5-bf", "ovs_interfaceid": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Converting VIF {"id": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "address": "fa:16:3e:8a:91:a9", "network": {"id": "c18bc66f-1d7e-41b4-b583-fce9e5d78cd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1141220283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17a0645348045aa82d80f7291a44d3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39dbc0a5-bf", "ovs_interfaceid": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:91:a9,bridge_name='br-int',has_traffic_filtering=True,id=39dbc0a5-bfeb-47fc-993b-06de27422f03,network=Network(c18bc66f-1d7e-41b4-b583-fce9e5d78cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39dbc0a5-bf') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG os_vif [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:91:a9,bridge_name='br-int',has_traffic_filtering=True,id=39dbc0a5-bfeb-47fc-993b-06de27422f03,network=Network(c18bc66f-1d7e-41b4-b583-fce9e5d78cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39dbc0a5-bf') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '430c41b1-ba71-5a5b-97df-809cc6166b77', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39dbc0a5-bf, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39dbc0a5-bf, col_values=(('qos', UUID('f6187da6-f4af-4c76-93cf-86384cf6d47d')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39dbc0a5-bf, col_values=(('external_ids', {'iface-id': '39dbc0a5-bfeb-47fc-993b-06de27422f03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:91:a9', 'vm-uuid': 'af957c0b-a655-4b55-974a-70256a760d3c'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:39 user nova-compute[75113]: INFO os_vif [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:91:a9,bridge_name='br-int',has_traffic_filtering=True,id=39dbc0a5-bfeb-47fc-993b-06de27422f03,network=Network(c18bc66f-1d7e-41b4-b583-fce9e5d78cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39dbc0a5-bf')
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] No BDM found with device name sda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] No VIF found with MAC fa:16:3e:8a:91:a9, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:54:39 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Using config drive
Oct 26 16:54:39 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Cannot resize image /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Ensure instance console log exists: /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Successfully updated port: 02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "refresh_cache-fbf1e605-91c5-4188-9081-f9762ad92a9f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquired lock "refresh_cache-fbf1e605-91c5-4188-9081-f9762ad92a9f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-290ec355-05b7-4f00-b9fd-d52234e0623d req-835a6eeb-340d-4cd4-9963-c391d835baa4 service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Received event network-changed-02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-290ec355-05b7-4f00-b9fd-d52234e0623d req-835a6eeb-340d-4cd4-9963-c391d835baa4 service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Refreshing instance network info cache due to event network-changed-02278050-c73c-493a-83c4-095f43697e9f. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-290ec355-05b7-4f00-b9fd-d52234e0623d req-835a6eeb-340d-4cd4-9963-c391d835baa4 service nova] Acquiring lock "refresh_cache-fbf1e605-91c5-4188-9081-f9762ad92a9f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:39 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:54:40 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Creating config drive at /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk.config
Oct 26 16:54:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfc8lfhmn {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.neutron [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Successfully updated port: 3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.compute.manager [req-07e30537-1547-4b09-8aa0-3a9a0564a7be req-9d029dde-8719-415d-a527-04cc5e4be763 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Received event network-changed-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.compute.manager [req-07e30537-1547-4b09-8aa0-3a9a0564a7be req-9d029dde-8719-415d-a527-04cc5e4be763 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Refreshing instance network info cache due to event network-changed-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-07e30537-1547-4b09-8aa0-3a9a0564a7be req-9d029dde-8719-415d-a527-04cc5e4be763 service nova] Acquiring lock "refresh_cache-e632e8ad-6d44-4a57-a04b-342bdf513260" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-07e30537-1547-4b09-8aa0-3a9a0564a7be req-9d029dde-8719-415d-a527-04cc5e4be763 service nova] Acquired lock "refresh_cache-e632e8ad-6d44-4a57-a04b-342bdf513260" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.neutron [req-07e30537-1547-4b09-8aa0-3a9a0564a7be req-9d029dde-8719-415d-a527-04cc5e4be763 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Refreshing network info cache for port 3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfc8lfhmn" returned: 0 in 0.063s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Acquiring lock "refresh_cache-e632e8ad-6d44-4a57-a04b-342bdf513260" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Updating instance_info_cache with network_info: [{"id": "02278050-c73c-493a-83c4-095f43697e9f", "address": "fa:16:3e:dc:3d:4b", "network": {"id": "04d9fbd9-4ccd-424a-ac46-2324eac68387", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1918515909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee6a73f02e54d7fa20bbe92d986f577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02278050-c7", "ovs_interfaceid": "02278050-c73c-493a-83c4-095f43697e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Releasing lock "refresh_cache-fbf1e605-91c5-4188-9081-f9762ad92a9f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Instance network_info: |[{"id": "02278050-c73c-493a-83c4-095f43697e9f", "address": "fa:16:3e:dc:3d:4b", "network": {"id": "04d9fbd9-4ccd-424a-ac46-2324eac68387", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1918515909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee6a73f02e54d7fa20bbe92d986f577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02278050-c7", "ovs_interfaceid": "02278050-c73c-493a-83c4-095f43697e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-290ec355-05b7-4f00-b9fd-d52234e0623d req-835a6eeb-340d-4cd4-9963-c391d835baa4 service nova] Acquired lock "refresh_cache-fbf1e605-91c5-4188-9081-f9762ad92a9f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.neutron [req-290ec355-05b7-4f00-b9fd-d52234e0623d req-835a6eeb-340d-4cd4-9963-c391d835baa4 service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Refreshing network info cache for port 02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Start _get_guest_xml network_info=[{"id": "02278050-c73c-493a-83c4-095f43697e9f", "address": "fa:16:3e:dc:3d:4b", "network": {"id": "04d9fbd9-4ccd-424a-ac46-2324eac68387", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1918515909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee6a73f02e54d7fa20bbe92d986f577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02278050-c7", "ovs_interfaceid": "02278050-c73c-493a-83c4-095f43697e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:54:40 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:40 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.neutron [req-07e30537-1547-4b09-8aa0-3a9a0564a7be req-9d029dde-8719-415d-a527-04cc5e4be763 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-937411519',display_name='tempest-TestVolumeSwap-server-937411519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-937411519',id=6,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv7/sgXZqMFiyaj1arm45b3jX/OsP+apDV4SSiN1UIafxjPoXasxYmUUT5wpq+MoV6DCiCRCI48AR/t69UQgeS+pSfiMRt9rjfOK3aRD6TpTsgxZw9GILYQNbmkLQz7Cw==',key_name='tempest-keypair-1863371864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee6a73f02e54d7fa20bbe92d986f577',ramdisk_id='',reservation_id='r-q4cyljb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-576420899',owner_user_name='tempest-TestVolumeSwap-576420899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7cbd5018fe6453095388366e914a5d1',uuid=fbf1e605-91c5-4188-9081-f9762ad92a9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02278050-c73c-493a-83c4-095f43697e9f", "address": "fa:16:3e:dc:3d:4b", "network": {"id": "04d9fbd9-4ccd-424a-ac46-2324eac68387", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1918515909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee6a73f02e54d7fa20bbe92d986f577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02278050-c7", "ovs_interfaceid": "02278050-c73c-493a-83c4-095f43697e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Converting VIF {"id": "02278050-c73c-493a-83c4-095f43697e9f", "address": "fa:16:3e:dc:3d:4b", "network": {"id": "04d9fbd9-4ccd-424a-ac46-2324eac68387", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1918515909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee6a73f02e54d7fa20bbe92d986f577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02278050-c7", "ovs_interfaceid": "02278050-c73c-493a-83c4-095f43697e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3d:4b,bridge_name='br-int',has_traffic_filtering=True,id=02278050-c73c-493a-83c4-095f43697e9f,network=Network(04d9fbd9-4ccd-424a-ac46-2324eac68387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02278050-c7') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lazy-loading 'pci_devices' on Instance uuid fbf1e605-91c5-4188-9081-f9762ad92a9f {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:54:40 user nova-compute[75113]:   <uuid>fbf1e605-91c5-4188-9081-f9762ad92a9f</uuid>
Oct 26 16:54:40 user nova-compute[75113]:   <name>instance-00000006</name>
Oct 26 16:54:40 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:54:40 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:54:40 user nova-compute[75113]:   <metadata>
Oct 26 16:54:40 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:54:40 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:54:40 user nova-compute[75113]:       <nova:name>tempest-TestVolumeSwap-server-937411519</nova:name>
Oct 26 16:54:40 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:54:40</nova:creationTime>
Oct 26 16:54:40 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:54:40 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:54:40 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:54:40 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:54:40 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:54:40 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:54:40 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:54:40 user nova-compute[75113]:       <nova:owner>
Oct 26 16:54:40 user nova-compute[75113]:         <nova:user uuid="e7cbd5018fe6453095388366e914a5d1">tempest-TestVolumeSwap-576420899-project-member</nova:user>
Oct 26 16:54:40 user nova-compute[75113]:         <nova:project uuid="3ee6a73f02e54d7fa20bbe92d986f577">tempest-TestVolumeSwap-576420899</nova:project>
Oct 26 16:54:40 user nova-compute[75113]:       </nova:owner>
Oct 26 16:54:40 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:54:40 user nova-compute[75113]:       <nova:ports>
Oct 26 16:54:40 user nova-compute[75113]:         <nova:port uuid="02278050-c73c-493a-83c4-095f43697e9f">
Oct 26 16:54:40 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 16:54:40 user nova-compute[75113]:         </nova:port>
Oct 26 16:54:40 user nova-compute[75113]:       </nova:ports>
Oct 26 16:54:40 user nova-compute[75113]:     </nova:instance>
Oct 26 16:54:40 user nova-compute[75113]:   </metadata>
Oct 26 16:54:40 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:54:40 user nova-compute[75113]:     <system>
Oct 26 16:54:40 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:54:40 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:54:40 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:54:40 user nova-compute[75113]:       <entry name="serial">fbf1e605-91c5-4188-9081-f9762ad92a9f</entry>
Oct 26 16:54:40 user nova-compute[75113]:       <entry name="uuid">fbf1e605-91c5-4188-9081-f9762ad92a9f</entry>
Oct 26 16:54:40 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:54:40 user nova-compute[75113]:     </system>
Oct 26 16:54:40 user nova-compute[75113]:   </sysinfo>
Oct 26 16:54:40 user nova-compute[75113]:   <os>
Oct 26 16:54:40 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:54:40 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:54:40 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:54:40 user nova-compute[75113]:   </os>
Oct 26 16:54:40 user nova-compute[75113]:   <features>
Oct 26 16:54:40 user nova-compute[75113]:     <acpi/>
Oct 26 16:54:40 user nova-compute[75113]:     <apic/>
Oct 26 16:54:40 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:54:40 user nova-compute[75113]:   </features>
Oct 26 16:54:40 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:54:40 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:54:40 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:54:40 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:54:40 user nova-compute[75113]:   </clock>
Oct 26 16:54:40 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:54:40 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:54:40 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:54:40 user nova-compute[75113]:   </cpu>
Oct 26 16:54:40 user nova-compute[75113]:   <devices>
Oct 26 16:54:40 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:54:40 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:54:40 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk"/>
Oct 26 16:54:40 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:54:40 user nova-compute[75113]:     </disk>
Oct 26 16:54:40 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:54:40 user nova-compute[75113]:       <mac address="fa:16:3e:dc:3d:4b"/>
Oct 26 16:54:40 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:40 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:54:40 user nova-compute[75113]:       <target dev="tap02278050-c7"/>
Oct 26 16:54:40 user nova-compute[75113]:     </interface>
Oct 26 16:54:40 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:54:40 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/console.log" append="off"/>
Oct 26 16:54:40 user nova-compute[75113]:     </serial>
Oct 26 16:54:40 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:54:40 user nova-compute[75113]:     <video>
Oct 26 16:54:40 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:40 user nova-compute[75113]:     </video>
Oct 26 16:54:40 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:54:40 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:54:40 user nova-compute[75113]:     </rng>
Oct 26 16:54:40 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:54:40 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:54:40 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:54:40 user nova-compute[75113]:     </memballoon>
Oct 26 16:54:40 user nova-compute[75113]:   </devices>
Oct 26 16:54:40 user nova-compute[75113]: </domain>
Oct 26 16:54:40 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-937411519',display_name='tempest-TestVolumeSwap-server-937411519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-937411519',id=6,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv7/sgXZqMFiyaj1arm45b3jX/OsP+apDV4SSiN1UIafxjPoXasxYmUUT5wpq+MoV6DCiCRCI48AR/t69UQgeS+pSfiMRt9rjfOK3aRD6TpTsgxZw9GILYQNbmkLQz7Cw==',key_name='tempest-keypair-1863371864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee6a73f02e54d7fa20bbe92d986f577',ramdisk_id='',reservation_id='r-q4cyljb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-576420899',owner_user_name='tempest-TestVolumeSwap-576420899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7cbd5018fe6453095388366e914a5d1',uuid=fbf1e605-91c5-4188-9081-f9762ad92a9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02278050-c73c-493a-83c4-095f43697e9f", "address": "fa:16:3e:dc:3d:4b", "network": {"id": "04d9fbd9-4ccd-424a-ac46-2324eac68387", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1918515909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee6a73f02e54d7fa20bbe92d986f577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02278050-c7", "ovs_interfaceid": "02278050-c73c-493a-83c4-095f43697e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Converting VIF {"id": "02278050-c73c-493a-83c4-095f43697e9f", "address": "fa:16:3e:dc:3d:4b", "network": {"id": "04d9fbd9-4ccd-424a-ac46-2324eac68387", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1918515909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee6a73f02e54d7fa20bbe92d986f577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02278050-c7", "ovs_interfaceid": "02278050-c73c-493a-83c4-095f43697e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3d:4b,bridge_name='br-int',has_traffic_filtering=True,id=02278050-c73c-493a-83c4-095f43697e9f,network=Network(04d9fbd9-4ccd-424a-ac46-2324eac68387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02278050-c7') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG os_vif [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3d:4b,bridge_name='br-int',has_traffic_filtering=True,id=02278050-c73c-493a-83c4-095f43697e9f,network=Network(04d9fbd9-4ccd-424a-ac46-2324eac68387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02278050-c7') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6aa1a977-7416-591f-a0b1-378424e00812', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02278050-c7, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02278050-c7, col_values=(('qos', UUID('d98a1f37-458e-4a70-8c54-f05867da7c3e')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02278050-c7, col_values=(('external_ids', {'iface-id': '02278050-c73c-493a-83c4-095f43697e9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:3d:4b', 'vm-uuid': 'fbf1e605-91c5-4188-9081-f9762ad92a9f'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:40 user nova-compute[75113]: INFO os_vif [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3d:4b,bridge_name='br-int',has_traffic_filtering=True,id=02278050-c73c-493a-83c4-095f43697e9f,network=Network(04d9fbd9-4ccd-424a-ac46-2324eac68387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02278050-c7')
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] No VIF found with MAC fa:16:3e:dc:3d:4b, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.neutron [req-07e30537-1547-4b09-8aa0-3a9a0564a7be req-9d029dde-8719-415d-a527-04cc5e4be763 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-07e30537-1547-4b09-8aa0-3a9a0564a7be req-9d029dde-8719-415d-a527-04cc5e4be763 service nova] Releasing lock "refresh_cache-e632e8ad-6d44-4a57-a04b-342bdf513260" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.neutron [req-290ec355-05b7-4f00-b9fd-d52234e0623d req-835a6eeb-340d-4cd4-9963-c391d835baa4 service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Updated VIF entry in instance network info cache for port 02278050-c73c-493a-83c4-095f43697e9f. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.neutron [req-290ec355-05b7-4f00-b9fd-d52234e0623d req-835a6eeb-340d-4cd4-9963-c391d835baa4 service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Updating instance_info_cache with network_info: [{"id": "02278050-c73c-493a-83c4-095f43697e9f", "address": "fa:16:3e:dc:3d:4b", "network": {"id": "04d9fbd9-4ccd-424a-ac46-2324eac68387", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1918515909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee6a73f02e54d7fa20bbe92d986f577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02278050-c7", "ovs_interfaceid": "02278050-c73c-493a-83c4-095f43697e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Acquired lock "refresh_cache-e632e8ad-6d44-4a57-a04b-342bdf513260" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.neutron [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-290ec355-05b7-4f00-b9fd-d52234e0623d req-835a6eeb-340d-4cd4-9963-c391d835baa4 service nova] Releasing lock "refresh_cache-fbf1e605-91c5-4188-9081-f9762ad92a9f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:40 user nova-compute[75113]: DEBUG nova.network.neutron [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.network.neutron [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Updating instance_info_cache with network_info: [{"id": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "address": "fa:16:3e:8a:01:23", "network": {"id": "36a5fd04-a05e-4e2c-931a-f186ee527b78", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-577328747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154d6bc4a64448cba3150f04e0d5834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb4bd76-9c", "ovs_interfaceid": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Releasing lock "refresh_cache-e632e8ad-6d44-4a57-a04b-342bdf513260" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.compute.manager [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Instance network_info: |[{"id": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "address": "fa:16:3e:8a:01:23", "network": {"id": "36a5fd04-a05e-4e2c-931a-f186ee527b78", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-577328747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154d6bc4a64448cba3150f04e0d5834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb4bd76-9c", "ovs_interfaceid": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Start _get_guest_xml network_info=[{"id": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "address": "fa:16:3e:8a:01:23", "network": {"id": "36a5fd04-a05e-4e2c-931a-f186ee527b78", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-577328747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154d6bc4a64448cba3150f04e0d5834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb4bd76-9c", "ovs_interfaceid": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:54:41 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:41 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1122499831',display_name='tempest-VolumesAssistedSnapshotsTest-server-1122499831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1122499831',id=7,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG1yqgEOnIi6/+1HsTpcEr2y2lxZUAZCl75aKh3Z38CcSvU1hKv9rzCa+Hpey31wAH9NFI9I2q/PusMMv5xsUyBwTGhEWsVOhJT2ikHcxAEA6L/0cC3E0Qui1fMHOQqEQ==',key_name='tempest-keypair-1150854869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9154d6bc4a64448cba3150f04e0d5834',ramdisk_id='',reservation_id='r-s7b34hck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1545201126',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1545201126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1933ebb859b64f4f95374d9ef8948ff0',uuid=e632e8ad-6d44-4a57-a04b-342bdf513260,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "address": "fa:16:3e:8a:01:23", "network": {"id": "36a5fd04-a05e-4e2c-931a-f186ee527b78", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-577328747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154d6bc4a64448cba3150f04e0d5834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb4bd76-9c", "ovs_interfaceid": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Converting VIF {"id": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "address": "fa:16:3e:8a:01:23", "network": {"id": "36a5fd04-a05e-4e2c-931a-f186ee527b78", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-577328747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154d6bc4a64448cba3150f04e0d5834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb4bd76-9c", "ovs_interfaceid": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:01:23,bridge_name='br-int',has_traffic_filtering=True,id=3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22,network=Network(36a5fd04-a05e-4e2c-931a-f186ee527b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb4bd76-9c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.objects.instance [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lazy-loading 'pci_devices' on Instance uuid e632e8ad-6d44-4a57-a04b-342bdf513260 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:54:41 user nova-compute[75113]:   <uuid>e632e8ad-6d44-4a57-a04b-342bdf513260</uuid>
Oct 26 16:54:41 user nova-compute[75113]:   <name>instance-00000007</name>
Oct 26 16:54:41 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:54:41 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:54:41 user nova-compute[75113]:   <metadata>
Oct 26 16:54:41 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:54:41 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:54:41 user nova-compute[75113]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1122499831</nova:name>
Oct 26 16:54:41 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:54:41</nova:creationTime>
Oct 26 16:54:41 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:54:41 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:54:41 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:54:41 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:54:41 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:54:41 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:54:41 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:54:41 user nova-compute[75113]:       <nova:owner>
Oct 26 16:54:41 user nova-compute[75113]:         <nova:user uuid="1933ebb859b64f4f95374d9ef8948ff0">tempest-VolumesAssistedSnapshotsTest-1545201126-project-member</nova:user>
Oct 26 16:54:41 user nova-compute[75113]:         <nova:project uuid="9154d6bc4a64448cba3150f04e0d5834">tempest-VolumesAssistedSnapshotsTest-1545201126</nova:project>
Oct 26 16:54:41 user nova-compute[75113]:       </nova:owner>
Oct 26 16:54:41 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:54:41 user nova-compute[75113]:       <nova:ports>
Oct 26 16:54:41 user nova-compute[75113]:         <nova:port uuid="3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22">
Oct 26 16:54:41 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 16:54:41 user nova-compute[75113]:         </nova:port>
Oct 26 16:54:41 user nova-compute[75113]:       </nova:ports>
Oct 26 16:54:41 user nova-compute[75113]:     </nova:instance>
Oct 26 16:54:41 user nova-compute[75113]:   </metadata>
Oct 26 16:54:41 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:54:41 user nova-compute[75113]:     <system>
Oct 26 16:54:41 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:54:41 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:54:41 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:54:41 user nova-compute[75113]:       <entry name="serial">e632e8ad-6d44-4a57-a04b-342bdf513260</entry>
Oct 26 16:54:41 user nova-compute[75113]:       <entry name="uuid">e632e8ad-6d44-4a57-a04b-342bdf513260</entry>
Oct 26 16:54:41 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:54:41 user nova-compute[75113]:     </system>
Oct 26 16:54:41 user nova-compute[75113]:   </sysinfo>
Oct 26 16:54:41 user nova-compute[75113]:   <os>
Oct 26 16:54:41 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:54:41 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:54:41 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:54:41 user nova-compute[75113]:   </os>
Oct 26 16:54:41 user nova-compute[75113]:   <features>
Oct 26 16:54:41 user nova-compute[75113]:     <acpi/>
Oct 26 16:54:41 user nova-compute[75113]:     <apic/>
Oct 26 16:54:41 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:54:41 user nova-compute[75113]:   </features>
Oct 26 16:54:41 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:54:41 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:54:41 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:54:41 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:54:41 user nova-compute[75113]:   </clock>
Oct 26 16:54:41 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:54:41 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:54:41 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:54:41 user nova-compute[75113]:   </cpu>
Oct 26 16:54:41 user nova-compute[75113]:   <devices>
Oct 26 16:54:41 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:54:41 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:54:41 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk"/>
Oct 26 16:54:41 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:54:41 user nova-compute[75113]:     </disk>
Oct 26 16:54:41 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:54:41 user nova-compute[75113]:       <mac address="fa:16:3e:8a:01:23"/>
Oct 26 16:54:41 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:41 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:54:41 user nova-compute[75113]:       <target dev="tap3cb4bd76-9c"/>
Oct 26 16:54:41 user nova-compute[75113]:     </interface>
Oct 26 16:54:41 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:54:41 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/console.log" append="off"/>
Oct 26 16:54:41 user nova-compute[75113]:     </serial>
Oct 26 16:54:41 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:54:41 user nova-compute[75113]:     <video>
Oct 26 16:54:41 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:41 user nova-compute[75113]:     </video>
Oct 26 16:54:41 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:54:41 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:54:41 user nova-compute[75113]:     </rng>
Oct 26 16:54:41 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:54:41 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:54:41 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:54:41 user nova-compute[75113]:     </memballoon>
Oct 26 16:54:41 user nova-compute[75113]:   </devices>
Oct 26 16:54:41 user nova-compute[75113]: </domain>
Oct 26 16:54:41 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1122499831',display_name='tempest-VolumesAssistedSnapshotsTest-server-1122499831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1122499831',id=7,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG1yqgEOnIi6/+1HsTpcEr2y2lxZUAZCl75aKh3Z38CcSvU1hKv9rzCa+Hpey31wAH9NFI9I2q/PusMMv5xsUyBwTGhEWsVOhJT2ikHcxAEA6L/0cC3E0Qui1fMHOQqEQ==',key_name='tempest-keypair-1150854869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9154d6bc4a64448cba3150f04e0d5834',ramdisk_id='',reservation_id='r-s7b34hck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1545201126',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1545201126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1933ebb859b64f4f95374d9ef8948ff0',uuid=e632e8ad-6d44-4a57-a04b-342bdf513260,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "address": "fa:16:3e:8a:01:23", "network": {"id": "36a5fd04-a05e-4e2c-931a-f186ee527b78", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-577328747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154d6bc4a64448cba3150f04e0d5834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb4bd76-9c", "ovs_interfaceid": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Converting VIF {"id": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "address": "fa:16:3e:8a:01:23", "network": {"id": "36a5fd04-a05e-4e2c-931a-f186ee527b78", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-577328747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154d6bc4a64448cba3150f04e0d5834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb4bd76-9c", "ovs_interfaceid": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:01:23,bridge_name='br-int',has_traffic_filtering=True,id=3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22,network=Network(36a5fd04-a05e-4e2c-931a-f186ee527b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb4bd76-9c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG os_vif [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:01:23,bridge_name='br-int',has_traffic_filtering=True,id=3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22,network=Network(36a5fd04-a05e-4e2c-931a-f186ee527b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb4bd76-9c') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa61ef53-c2f4-5972-bb54-cd4eaee48aa7', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cb4bd76-9c, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3cb4bd76-9c, col_values=(('qos', UUID('249c56b4-cfbb-4155-a0c5-088efd3daf21')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3cb4bd76-9c, col_values=(('external_ids', {'iface-id': '3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:01:23', 'vm-uuid': 'e632e8ad-6d44-4a57-a04b-342bdf513260'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:41 user nova-compute[75113]: INFO os_vif [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:01:23,bridge_name='br-int',has_traffic_filtering=True,id=3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22,network=Network(36a5fd04-a05e-4e2c-931a-f186ee527b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb4bd76-9c')
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:54:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] No VIF found with MAC fa:16:3e:8a:01:23, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG nova.compute.manager [req-108176ab-fbe2-409a-a0ba-274033aa14fe req-6e9297bb-8e03-4709-b347-03120224b999 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Received event network-vif-plugged-39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-108176ab-fbe2-409a-a0ba-274033aa14fe req-6e9297bb-8e03-4709-b347-03120224b999 service nova] Acquiring lock "af957c0b-a655-4b55-974a-70256a760d3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-108176ab-fbe2-409a-a0ba-274033aa14fe req-6e9297bb-8e03-4709-b347-03120224b999 service nova] Lock "af957c0b-a655-4b55-974a-70256a760d3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-108176ab-fbe2-409a-a0ba-274033aa14fe req-6e9297bb-8e03-4709-b347-03120224b999 service nova] Lock "af957c0b-a655-4b55-974a-70256a760d3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG nova.compute.manager [req-108176ab-fbe2-409a-a0ba-274033aa14fe req-6e9297bb-8e03-4709-b347-03120224b999 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] No waiting events found dispatching network-vif-plugged-39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:42 user nova-compute[75113]: WARNING nova.compute.manager [req-108176ab-fbe2-409a-a0ba-274033aa14fe req-6e9297bb-8e03-4709-b347-03120224b999 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Received unexpected event network-vif-plugged-39dbc0a5-bfeb-47fc-993b-06de27422f03 for instance with vm_state building and task_state spawning.
Oct 26 16:54:42 user nova-compute[75113]: DEBUG nova.compute.manager [req-6a22e56e-8bae-4a37-81ec-baf317760359 req-71d9c59e-a9c8-4370-ae7b-d459bf625762 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6a22e56e-8bae-4a37-81ec-baf317760359 req-71d9c59e-a9c8-4370-ae7b-d459bf625762 service nova] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6a22e56e-8bae-4a37-81ec-baf317760359 req-71d9c59e-a9c8-4370-ae7b-d459bf625762 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6a22e56e-8bae-4a37-81ec-baf317760359 req-71d9c59e-a9c8-4370-ae7b-d459bf625762 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG nova.compute.manager [req-6a22e56e-8bae-4a37-81ec-baf317760359 req-71d9c59e-a9c8-4370-ae7b-d459bf625762 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] No waiting events found dispatching network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:42 user nova-compute[75113]: WARNING nova.compute.manager [req-6a22e56e-8bae-4a37-81ec-baf317760359 req-71d9c59e-a9c8-4370-ae7b-d459bf625762 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received unexpected event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 for instance with vm_state active and task_state None.
Oct 26 16:54:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "9064edf2-de11-4223-baed-d346bfe34fcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG nova.compute.manager [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:54:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:54:43 user nova-compute[75113]: INFO nova.compute.claims [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Claim successful on node user
Oct 26 16:54:43 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:54:43 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:54:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.network.neutron [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:54:44 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.policy [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3b34c772fc54da89ff6787f12fef797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c7a88071a24c96abb06407c59a2775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:54:44 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Creating image(s)
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-fbee8915-4e94-455c-9f7b-4ead1e1fd410 req-e5da9153-d9c0-4431-83de-adab14ed1746 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Received event network-vif-plugged-39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fbee8915-4e94-455c-9f7b-4ead1e1fd410 req-e5da9153-d9c0-4431-83de-adab14ed1746 service nova] Acquiring lock "af957c0b-a655-4b55-974a-70256a760d3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fbee8915-4e94-455c-9f7b-4ead1e1fd410 req-e5da9153-d9c0-4431-83de-adab14ed1746 service nova] Lock "af957c0b-a655-4b55-974a-70256a760d3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fbee8915-4e94-455c-9f7b-4ead1e1fd410 req-e5da9153-d9c0-4431-83de-adab14ed1746 service nova] Lock "af957c0b-a655-4b55-974a-70256a760d3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-fbee8915-4e94-455c-9f7b-4ead1e1fd410 req-e5da9153-d9c0-4431-83de-adab14ed1746 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] No waiting events found dispatching network-vif-plugged-39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:44 user nova-compute[75113]: WARNING nova.compute.manager [req-fbee8915-4e94-455c-9f7b-4ead1e1fd410 req-e5da9153-d9c0-4431-83de-adab14ed1746 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Received unexpected event network-vif-plugged-39dbc0a5-bfeb-47fc-993b-06de27422f03 for instance with vm_state building and task_state spawning.
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.223s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] No waiting events found dispatching network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:44 user nova-compute[75113]: WARNING nova.compute.manager [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received unexpected event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 for instance with vm_state active and task_state None.
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Received event network-vif-plugged-8af075bf-d8dd-478d-9f83-3faf420bc6c6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] Acquiring lock "f1769d95-897b-4e83-89ba-c486aa086dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] No waiting events found dispatching network-vif-plugged-8af075bf-d8dd-478d-9f83-3faf420bc6c6 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:44 user nova-compute[75113]: WARNING nova.compute.manager [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Received unexpected event network-vif-plugged-8af075bf-d8dd-478d-9f83-3faf420bc6c6 for instance with vm_state active and task_state None.
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Received event network-vif-plugged-8af075bf-d8dd-478d-9f83-3faf420bc6c6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] Acquiring lock "f1769d95-897b-4e83-89ba-c486aa086dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] No waiting events found dispatching network-vif-plugged-8af075bf-d8dd-478d-9f83-3faf420bc6c6 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:44 user nova-compute[75113]: WARNING nova.compute.manager [req-dc78c9a1-d8a6-42cf-b306-f8f6ecfb2a19 req-f96a9c9b-67bf-4b32-be28-80753b8d3ea1 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Received unexpected event network-vif-plugged-8af075bf-d8dd-478d-9f83-3faf420bc6c6 for instance with vm_state active and task_state None.
Oct 26 16:54:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.342s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG nova.network.neutron [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Successfully created port: b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:54:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk 1073741824" returned: 0 in 0.087s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.435s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Cannot resize image /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Ensure instance console log exists: /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-5ca0d702-1000-49e9-b357-0f964cd8d08a req-bd907aa6-c396-41f4-822f-160c5146478d service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Received event network-vif-plugged-02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5ca0d702-1000-49e9-b357-0f964cd8d08a req-bd907aa6-c396-41f4-822f-160c5146478d service nova] Acquiring lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5ca0d702-1000-49e9-b357-0f964cd8d08a req-bd907aa6-c396-41f4-822f-160c5146478d service nova] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5ca0d702-1000-49e9-b357-0f964cd8d08a req-bd907aa6-c396-41f4-822f-160c5146478d service nova] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-5ca0d702-1000-49e9-b357-0f964cd8d08a req-bd907aa6-c396-41f4-822f-160c5146478d service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] No waiting events found dispatching network-vif-plugged-02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:45 user nova-compute[75113]: WARNING nova.compute.manager [req-5ca0d702-1000-49e9-b357-0f964cd8d08a req-bd907aa6-c396-41f4-822f-160c5146478d service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Received unexpected event network-vif-plugged-02278050-c73c-493a-83c4-095f43697e9f for instance with vm_state building and task_state spawning.
Oct 26 16:54:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Successfully updated port: b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquired lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Updating instance_info_cache with network_info: [{"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Releasing lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Instance network_info: |[{"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Start _get_guest_xml network_info=[{"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-d121faf3-f23e-41b0-b4ec-18b5b95d67da req-2ea94c36-765c-4ff7-ab19-6061b162a495 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Received event network-vif-plugged-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d121faf3-f23e-41b0-b4ec-18b5b95d67da req-2ea94c36-765c-4ff7-ab19-6061b162a495 service nova] Acquiring lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d121faf3-f23e-41b0-b4ec-18b5b95d67da req-2ea94c36-765c-4ff7-ab19-6061b162a495 service nova] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d121faf3-f23e-41b0-b4ec-18b5b95d67da req-2ea94c36-765c-4ff7-ab19-6061b162a495 service nova] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-d121faf3-f23e-41b0-b4ec-18b5b95d67da req-2ea94c36-765c-4ff7-ab19-6061b162a495 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] No waiting events found dispatching network-vif-plugged-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:46 user nova-compute[75113]: WARNING nova.compute.manager [req-d121faf3-f23e-41b0-b4ec-18b5b95d67da req-2ea94c36-765c-4ff7-ab19-6061b162a495 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Received unexpected event network-vif-plugged-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 for instance with vm_state building and task_state spawning.
Oct 26 16:54:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-d121faf3-f23e-41b0-b4ec-18b5b95d67da req-2ea94c36-765c-4ff7-ab19-6061b162a495 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Received event network-vif-plugged-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d121faf3-f23e-41b0-b4ec-18b5b95d67da req-2ea94c36-765c-4ff7-ab19-6061b162a495 service nova] Acquiring lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d121faf3-f23e-41b0-b4ec-18b5b95d67da req-2ea94c36-765c-4ff7-ab19-6061b162a495 service nova] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d121faf3-f23e-41b0-b4ec-18b5b95d67da req-2ea94c36-765c-4ff7-ab19-6061b162a495 service nova] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-d121faf3-f23e-41b0-b4ec-18b5b95d67da req-2ea94c36-765c-4ff7-ab19-6061b162a495 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] No waiting events found dispatching network-vif-plugged-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:46 user nova-compute[75113]: WARNING nova.compute.manager [req-d121faf3-f23e-41b0-b4ec-18b5b95d67da req-2ea94c36-765c-4ff7-ab19-6061b162a495 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Received unexpected event network-vif-plugged-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 for instance with vm_state building and task_state spawning.
Oct 26 16:54:47 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:47 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1384773775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1384773775',id=8,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESp5K/14Ggl6vrqYPJZwPerrbYDesNlYVE2P8OiIAmeuCFyfagPIf0wDUE44PKomsOLEBGK5zvmXNCoV246gjfXa+oGWMEfMNs4yKfAzQiMGQTrxjH+/YVUO6sO4X+6vw==',key_name='tempest-keypair-1710846497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87c7a88071a24c96abb06407c59a2775',ramdisk_id='',reservation_id='r-0pxw2si0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-508694228',owner_user_name='tempest-TaggedAttachmentsTest-508694228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3b34c772fc54da89ff6787f12fef797',uuid=9064edf2-de11-4223-baed-d346bfe34fcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converting VIF {"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:a4:ac,bridge_name='br-int',has_traffic_filtering=True,id=b55efe74-8efe-4e0d-a917-a9c47cae9a85,network=Network(c860b8a4-ed0c-4f6a-b072-db46ec3a9d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55efe74-8e') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.objects.instance [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lazy-loading 'pci_devices' on Instance uuid 9064edf2-de11-4223-baed-d346bfe34fcc {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:54:47 user nova-compute[75113]:   <uuid>9064edf2-de11-4223-baed-d346bfe34fcc</uuid>
Oct 26 16:54:47 user nova-compute[75113]:   <name>instance-00000008</name>
Oct 26 16:54:47 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:54:47 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:54:47 user nova-compute[75113]:   <metadata>
Oct 26 16:54:47 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:54:47 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:54:47 user nova-compute[75113]:       <nova:name>tempest-device-tagging-server-1384773775</nova:name>
Oct 26 16:54:47 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:54:47</nova:creationTime>
Oct 26 16:54:47 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:54:47 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:54:47 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:54:47 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:54:47 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:54:47 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:54:47 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:54:47 user nova-compute[75113]:       <nova:owner>
Oct 26 16:54:47 user nova-compute[75113]:         <nova:user uuid="c3b34c772fc54da89ff6787f12fef797">tempest-TaggedAttachmentsTest-508694228-project-member</nova:user>
Oct 26 16:54:47 user nova-compute[75113]:         <nova:project uuid="87c7a88071a24c96abb06407c59a2775">tempest-TaggedAttachmentsTest-508694228</nova:project>
Oct 26 16:54:47 user nova-compute[75113]:       </nova:owner>
Oct 26 16:54:47 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:54:47 user nova-compute[75113]:       <nova:ports>
Oct 26 16:54:47 user nova-compute[75113]:         <nova:port uuid="b55efe74-8efe-4e0d-a917-a9c47cae9a85">
Oct 26 16:54:47 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 16:54:47 user nova-compute[75113]:         </nova:port>
Oct 26 16:54:47 user nova-compute[75113]:       </nova:ports>
Oct 26 16:54:47 user nova-compute[75113]:     </nova:instance>
Oct 26 16:54:47 user nova-compute[75113]:   </metadata>
Oct 26 16:54:47 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:54:47 user nova-compute[75113]:     <system>
Oct 26 16:54:47 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:54:47 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:54:47 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:54:47 user nova-compute[75113]:       <entry name="serial">9064edf2-de11-4223-baed-d346bfe34fcc</entry>
Oct 26 16:54:47 user nova-compute[75113]:       <entry name="uuid">9064edf2-de11-4223-baed-d346bfe34fcc</entry>
Oct 26 16:54:47 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:54:47 user nova-compute[75113]:     </system>
Oct 26 16:54:47 user nova-compute[75113]:   </sysinfo>
Oct 26 16:54:47 user nova-compute[75113]:   <os>
Oct 26 16:54:47 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:54:47 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:54:47 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:54:47 user nova-compute[75113]:   </os>
Oct 26 16:54:47 user nova-compute[75113]:   <features>
Oct 26 16:54:47 user nova-compute[75113]:     <acpi/>
Oct 26 16:54:47 user nova-compute[75113]:     <apic/>
Oct 26 16:54:47 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:54:47 user nova-compute[75113]:   </features>
Oct 26 16:54:47 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:54:47 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:54:47 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:54:47 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:54:47 user nova-compute[75113]:   </clock>
Oct 26 16:54:47 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:54:47 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:54:47 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:54:47 user nova-compute[75113]:   </cpu>
Oct 26 16:54:47 user nova-compute[75113]:   <devices>
Oct 26 16:54:47 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:54:47 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:54:47 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk"/>
Oct 26 16:54:47 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:54:47 user nova-compute[75113]:     </disk>
Oct 26 16:54:47 user nova-compute[75113]:     <disk type="file" device="cdrom">
Oct 26 16:54:47 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 16:54:47 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk.config"/>
Oct 26 16:54:47 user nova-compute[75113]:       <target dev="hda" bus="ide"/>
Oct 26 16:54:47 user nova-compute[75113]:     </disk>
Oct 26 16:54:47 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:54:47 user nova-compute[75113]:       <mac address="fa:16:3e:84:a4:ac"/>
Oct 26 16:54:47 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:47 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:54:47 user nova-compute[75113]:       <target dev="tapb55efe74-8e"/>
Oct 26 16:54:47 user nova-compute[75113]:     </interface>
Oct 26 16:54:47 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:54:47 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/console.log" append="off"/>
Oct 26 16:54:47 user nova-compute[75113]:     </serial>
Oct 26 16:54:47 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:54:47 user nova-compute[75113]:     <video>
Oct 26 16:54:47 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:54:47 user nova-compute[75113]:     </video>
Oct 26 16:54:47 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:54:47 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:54:47 user nova-compute[75113]:     </rng>
Oct 26 16:54:47 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:54:47 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:54:47 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:54:47 user nova-compute[75113]:     </memballoon>
Oct 26 16:54:47 user nova-compute[75113]:   </devices>
Oct 26 16:54:47 user nova-compute[75113]: </domain>
Oct 26 16:54:47 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1384773775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1384773775',id=8,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESp5K/14Ggl6vrqYPJZwPerrbYDesNlYVE2P8OiIAmeuCFyfagPIf0wDUE44PKomsOLEBGK5zvmXNCoV246gjfXa+oGWMEfMNs4yKfAzQiMGQTrxjH+/YVUO6sO4X+6vw==',key_name='tempest-keypair-1710846497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87c7a88071a24c96abb06407c59a2775',ramdisk_id='',reservation_id='r-0pxw2si0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-508694228',owner_user_name='tempest-TaggedAttachmentsTest-508694228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3b34c772fc54da89ff6787f12fef797',uuid=9064edf2-de11-4223-baed-d346bfe34fcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converting VIF {"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:a4:ac,bridge_name='br-int',has_traffic_filtering=True,id=b55efe74-8efe-4e0d-a917-a9c47cae9a85,network=Network(c860b8a4-ed0c-4f6a-b072-db46ec3a9d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55efe74-8e') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG os_vif [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:a4:ac,bridge_name='br-int',has_traffic_filtering=True,id=b55efe74-8efe-4e0d-a917-a9c47cae9a85,network=Network(c860b8a4-ed0c-4f6a-b072-db46ec3a9d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55efe74-8e') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a25378c4-30da-5a31-86ae-dbc98cfd706c', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb55efe74-8e, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb55efe74-8e, col_values=(('qos', UUID('5c614884-c222-47a6-9b3e-861fc7170ca7')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb55efe74-8e, col_values=(('external_ids', {'iface-id': 'b55efe74-8efe-4e0d-a917-a9c47cae9a85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:a4:ac', 'vm-uuid': '9064edf2-de11-4223-baed-d346bfe34fcc'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:47 user nova-compute[75113]: INFO os_vif [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:a4:ac,bridge_name='br-int',has_traffic_filtering=True,id=b55efe74-8efe-4e0d-a917-a9c47cae9a85,network=Network(c860b8a4-ed0c-4f6a-b072-db46ec3a9d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55efe74-8e')
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] No BDM found with device name hda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] No VIF found with MAC fa:16:3e:84:a4:ac, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:54:47 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Using config drive
Oct 26 16:54:47 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Creating config drive at /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk.config
Oct 26 16:54:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9cejc7c5 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9cejc7c5" returned: 0 in 0.064s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Received event network-vif-plugged-02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] Acquiring lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] No waiting events found dispatching network-vif-plugged-02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:47 user nova-compute[75113]: WARNING nova.compute.manager [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Received unexpected event network-vif-plugged-02278050-c73c-493a-83c4-095f43697e9f for instance with vm_state building and task_state spawning.
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-changed-b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Refreshing instance network info cache due to event network-changed-b55efe74-8efe-4e0d-a917-a9c47cae9a85. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] Acquiring lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] Acquired lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:47 user nova-compute[75113]: DEBUG nova.network.neutron [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Refreshing network info cache for port b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:54:48 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Instance spawned successfully.
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.network.neutron [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Updated VIF entry in instance network info cache for port b55efe74-8efe-4e0d-a917-a9c47cae9a85. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.network.neutron [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Updating instance_info_cache with network_info: [{"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:48 user nova-compute[75113]: INFO nova.compute.manager [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Took 14.83 seconds to spawn the instance on the hypervisor.
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-84f0c700-367b-4ad6-a743-afe1479bac07 req-4f80fcad-02e7-428c-8403-3c49079d8401 service nova] Releasing lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:48 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Instance spawned successfully.
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:54:48 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Instance spawned successfully.
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:48 user nova-compute[75113]: INFO nova.compute.manager [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Took 10.95 seconds to spawn the instance on the hypervisor.
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:54:48 user nova-compute[75113]: INFO nova.compute.manager [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Took 16.44 seconds to build instance.
Oct 26 16:54:48 user nova-compute[75113]: INFO nova.compute.manager [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Took 12.16 seconds to spawn the instance on the hypervisor.
Oct 26 16:54:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:54:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e8fbdc27-3a8f-42ca-b851-3c6e9aa751c5 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "af957c0b-a655-4b55-974a-70256a760d3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.664s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:49 user nova-compute[75113]: INFO nova.compute.manager [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Took 12.49 seconds to build instance.
Oct 26 16:54:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f74848aa-cfcf-493f-8eac-40370ae74b4f tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.761s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:49 user nova-compute[75113]: INFO nova.compute.manager [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Took 13.82 seconds to build instance.
Oct 26 16:54:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2fde8174-91d3-462f-8b04-538bedb4ee57 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.128s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-22301e63-8d1e-4c02-9e1b-a18cd77e6dc3 req-0f6e93de-a8e7-4c2e-8632-abf5fa2e057b service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-vif-plugged-b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-22301e63-8d1e-4c02-9e1b-a18cd77e6dc3 req-0f6e93de-a8e7-4c2e-8632-abf5fa2e057b service nova] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-22301e63-8d1e-4c02-9e1b-a18cd77e6dc3 req-0f6e93de-a8e7-4c2e-8632-abf5fa2e057b service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-22301e63-8d1e-4c02-9e1b-a18cd77e6dc3 req-0f6e93de-a8e7-4c2e-8632-abf5fa2e057b service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-22301e63-8d1e-4c02-9e1b-a18cd77e6dc3 req-0f6e93de-a8e7-4c2e-8632-abf5fa2e057b service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] No waiting events found dispatching network-vif-plugged-b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:50 user nova-compute[75113]: WARNING nova.compute.manager [req-22301e63-8d1e-4c02-9e1b-a18cd77e6dc3 req-0f6e93de-a8e7-4c2e-8632-abf5fa2e057b service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received unexpected event network-vif-plugged-b55efe74-8efe-4e0d-a917-a9c47cae9a85 for instance with vm_state building and task_state spawning.
Oct 26 16:54:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:51 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:54:51 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 16:54:51 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] There are 0 instances to clean {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 16:54:51 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:54:51 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 16:54:51 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:54:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:54:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-63a6fb15-fa86-4b1a-8f69-85affabda986 req-f3c21677-b701-43a8-949b-67acbdeeab76 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-vif-plugged-b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:54:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-63a6fb15-fa86-4b1a-8f69-85affabda986 req-f3c21677-b701-43a8-949b-67acbdeeab76 service nova] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-63a6fb15-fa86-4b1a-8f69-85affabda986 req-f3c21677-b701-43a8-949b-67acbdeeab76 service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-63a6fb15-fa86-4b1a-8f69-85affabda986 req-f3c21677-b701-43a8-949b-67acbdeeab76 service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-63a6fb15-fa86-4b1a-8f69-85affabda986 req-f3c21677-b701-43a8-949b-67acbdeeab76 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] No waiting events found dispatching network-vif-plugged-b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:54:52 user nova-compute[75113]: WARNING nova.compute.manager [req-63a6fb15-fa86-4b1a-8f69-85affabda986 req-f3c21677-b701-43a8-949b-67acbdeeab76 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received unexpected event network-vif-plugged-b55efe74-8efe-4e0d-a917-a9c47cae9a85 for instance with vm_state building and task_state spawning.
Oct 26 16:54:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:54:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:54:53 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Instance spawned successfully.
Oct 26 16:54:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:54:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:54:53 user nova-compute[75113]: INFO nova.compute.manager [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Took 8.91 seconds to spawn the instance on the hypervisor.
Oct 26 16:54:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:54:53 user nova-compute[75113]: INFO nova.compute.manager [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Took 10.36 seconds to build instance.
Oct 26 16:54:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-89337707-c82c-46c9-b95b-4cffe7d89cfc tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "9064edf2-de11-4223-baed-d346bfe34fcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.514s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:54 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:54:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:54:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 16:54:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-ea7b1250-2387-491b-ac27-e1d3d27a13d2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:54:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-ea7b1250-2387-491b-ac27-e1d3d27a13d2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:54:54 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:54:54 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid ea7b1250-2387-491b-ac27-e1d3d27a13d2 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:54:55 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Updating instance_info_cache with network_info: [{"id": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "address": "fa:16:3e:1f:74:4a", "network": {"id": "70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-479778024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b8c64bc7f4d19b3a84d83dbebc813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a2219-e9", "ovs_interfaceid": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:54:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-ea7b1250-2387-491b-ac27-e1d3d27a13d2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:54:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:54:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:54:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:54:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:56 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:54:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:54:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:54:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:54:56 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:54:56 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:56 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:56 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:54:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:54:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:54:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:01 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:55:01 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:55:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7990MB free_disk=25.617393493652344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:55:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:55:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ea7b1250-2387-491b-ac27-e1d3d27a13d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 645deae0-4c03-41d0-aa3b-daa79ed25425 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 69ed2396-a603-4c84-a66b-7b474523b68e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance f1769d95-897b-4e83-89ba-c486aa086dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance af957c0b-a655-4b55-974a-70256a760d3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fbf1e605-91c5-4188-9081-f9762ad92a9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e632e8ad-6d44-4a57-a04b-342bdf513260 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9064edf2-de11-4223-baed-d346bfe34fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing inventories for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating ProviderTree inventory for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating inventory in ProviderTree for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing aggregate associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, aggregates: None {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing trait associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:55:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.153s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:55:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:55:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:55:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:55:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:55:03 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:55:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:55:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "a8368686-8c4d-4373-a3a5-4498e2086e0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:55:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:55:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:55:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:55:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:55:44 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:55:44 user nova-compute[75113]: INFO nova.compute.claims [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Claim successful on node user
Oct 26 16:55:44 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:55:44 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:55:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:55:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:55:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:55:44 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:55:44 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:55:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:55:44 user nova-compute[75113]: DEBUG nova.policy [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22531c3975dc4e29ab0e7be404592d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e6333344bf4cc6904e13f9fbe6005f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:55:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:55:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:55:44 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Creating image(s)
Oct 26 16:55:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:55:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "/opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:55:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "/opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:55:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk 1073741824" returned: 0 in 0.045s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Successfully created port: 52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Cannot resize image /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Ensure instance console log exists: /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:55:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Successfully updated port: 52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "refresh_cache-a8368686-8c4d-4373-a3a5-4498e2086e0d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquired lock "refresh_cache-a8368686-8c4d-4373-a3a5-4498e2086e0d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-7747f113-1224-4545-b0f4-e54f381d3bf2 req-db9922fa-e491-4437-890d-ca6059d33140 service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Received event network-changed-52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-7747f113-1224-4545-b0f4-e54f381d3bf2 req-db9922fa-e491-4437-890d-ca6059d33140 service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Refreshing instance network info cache due to event network-changed-52953b56-70f6-4307-9368-7622665234cb. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7747f113-1224-4545-b0f4-e54f381d3bf2 req-db9922fa-e491-4437-890d-ca6059d33140 service nova] Acquiring lock "refresh_cache-a8368686-8c4d-4373-a3a5-4498e2086e0d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Updating instance_info_cache with network_info: [{"id": "52953b56-70f6-4307-9368-7622665234cb", "address": "fa:16:3e:ef:35:6f", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52953b56-70", "ovs_interfaceid": "52953b56-70f6-4307-9368-7622665234cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Releasing lock "refresh_cache-a8368686-8c4d-4373-a3a5-4498e2086e0d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Instance network_info: |[{"id": "52953b56-70f6-4307-9368-7622665234cb", "address": "fa:16:3e:ef:35:6f", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52953b56-70", "ovs_interfaceid": "52953b56-70f6-4307-9368-7622665234cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7747f113-1224-4545-b0f4-e54f381d3bf2 req-db9922fa-e491-4437-890d-ca6059d33140 service nova] Acquired lock "refresh_cache-a8368686-8c4d-4373-a3a5-4498e2086e0d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.network.neutron [req-7747f113-1224-4545-b0f4-e54f381d3bf2 req-db9922fa-e491-4437-890d-ca6059d33140 service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Refreshing network info cache for port 52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Start _get_guest_xml network_info=[{"id": "52953b56-70f6-4307-9368-7622665234cb", "address": "fa:16:3e:ef:35:6f", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52953b56-70", "ovs_interfaceid": "52953b56-70f6-4307-9368-7622665234cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:55:46 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:55:46 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:55:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1886833755',display_name='tempest-VolumesSnapshotTestJSON-instance-1886833755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1886833755',id=9,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsgiw9wwZEneAl2mGFhjiCMItq1om3KMF6mUaG0y8H8ZdzGadtV3YxhKn8BVayd0I2FOR1jLrftT6sJD7K3U2MkmzyxF4ofuu9zfpA2yNaFE6yRLAaivNc8tdRotKPstg==',key_name='tempest-keypair-163189256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49e6333344bf4cc6904e13f9fbe6005f',ramdisk_id='',reservation_id='r-wthxvkl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1537589693',owner_user_name='tempest-VolumesSnapshotTestJSON-1537589693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22531c3975dc4e29ab0e7be404592d01',uuid=a8368686-8c4d-4373-a3a5-4498e2086e0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52953b56-70f6-4307-9368-7622665234cb", "address": "fa:16:3e:ef:35:6f", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52953b56-70", "ovs_interfaceid": "52953b56-70f6-4307-9368-7622665234cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Converting VIF {"id": "52953b56-70f6-4307-9368-7622665234cb", "address": "fa:16:3e:ef:35:6f", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52953b56-70", "ovs_interfaceid": "52953b56-70f6-4307-9368-7622665234cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:35:6f,bridge_name='br-int',has_traffic_filtering=True,id=52953b56-70f6-4307-9368-7622665234cb,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52953b56-70') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.objects.instance [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lazy-loading 'pci_devices' on Instance uuid a8368686-8c4d-4373-a3a5-4498e2086e0d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:55:46 user nova-compute[75113]:   <uuid>a8368686-8c4d-4373-a3a5-4498e2086e0d</uuid>
Oct 26 16:55:46 user nova-compute[75113]:   <name>instance-00000009</name>
Oct 26 16:55:46 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:55:46 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:55:46 user nova-compute[75113]:   <metadata>
Oct 26 16:55:46 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:55:46 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:55:46 user nova-compute[75113]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1886833755</nova:name>
Oct 26 16:55:46 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:55:46</nova:creationTime>
Oct 26 16:55:46 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:55:46 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:55:46 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:55:46 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:55:46 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:55:46 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:55:46 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:55:46 user nova-compute[75113]:       <nova:owner>
Oct 26 16:55:46 user nova-compute[75113]:         <nova:user uuid="22531c3975dc4e29ab0e7be404592d01">tempest-VolumesSnapshotTestJSON-1537589693-project-member</nova:user>
Oct 26 16:55:46 user nova-compute[75113]:         <nova:project uuid="49e6333344bf4cc6904e13f9fbe6005f">tempest-VolumesSnapshotTestJSON-1537589693</nova:project>
Oct 26 16:55:46 user nova-compute[75113]:       </nova:owner>
Oct 26 16:55:46 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:55:46 user nova-compute[75113]:       <nova:ports>
Oct 26 16:55:46 user nova-compute[75113]:         <nova:port uuid="52953b56-70f6-4307-9368-7622665234cb">
Oct 26 16:55:46 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 16:55:46 user nova-compute[75113]:         </nova:port>
Oct 26 16:55:46 user nova-compute[75113]:       </nova:ports>
Oct 26 16:55:46 user nova-compute[75113]:     </nova:instance>
Oct 26 16:55:46 user nova-compute[75113]:   </metadata>
Oct 26 16:55:46 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:55:46 user nova-compute[75113]:     <system>
Oct 26 16:55:46 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:55:46 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:55:46 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:55:46 user nova-compute[75113]:       <entry name="serial">a8368686-8c4d-4373-a3a5-4498e2086e0d</entry>
Oct 26 16:55:46 user nova-compute[75113]:       <entry name="uuid">a8368686-8c4d-4373-a3a5-4498e2086e0d</entry>
Oct 26 16:55:46 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:55:46 user nova-compute[75113]:     </system>
Oct 26 16:55:46 user nova-compute[75113]:   </sysinfo>
Oct 26 16:55:46 user nova-compute[75113]:   <os>
Oct 26 16:55:46 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:55:46 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:55:46 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:55:46 user nova-compute[75113]:   </os>
Oct 26 16:55:46 user nova-compute[75113]:   <features>
Oct 26 16:55:46 user nova-compute[75113]:     <acpi/>
Oct 26 16:55:46 user nova-compute[75113]:     <apic/>
Oct 26 16:55:46 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:55:46 user nova-compute[75113]:   </features>
Oct 26 16:55:46 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:55:46 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:55:46 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:55:46 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:55:46 user nova-compute[75113]:   </clock>
Oct 26 16:55:46 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:55:46 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:55:46 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:55:46 user nova-compute[75113]:   </cpu>
Oct 26 16:55:46 user nova-compute[75113]:   <devices>
Oct 26 16:55:46 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:55:46 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:55:46 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk"/>
Oct 26 16:55:46 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:55:46 user nova-compute[75113]:     </disk>
Oct 26 16:55:46 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:55:46 user nova-compute[75113]:       <mac address="fa:16:3e:ef:35:6f"/>
Oct 26 16:55:46 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:55:46 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:55:46 user nova-compute[75113]:       <target dev="tap52953b56-70"/>
Oct 26 16:55:46 user nova-compute[75113]:     </interface>
Oct 26 16:55:46 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:55:46 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/console.log" append="off"/>
Oct 26 16:55:46 user nova-compute[75113]:     </serial>
Oct 26 16:55:46 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:55:46 user nova-compute[75113]:     <video>
Oct 26 16:55:46 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:55:46 user nova-compute[75113]:     </video>
Oct 26 16:55:46 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:55:46 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:55:46 user nova-compute[75113]:     </rng>
Oct 26 16:55:46 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:55:46 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:55:46 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:55:46 user nova-compute[75113]:     </memballoon>
Oct 26 16:55:46 user nova-compute[75113]:   </devices>
Oct 26 16:55:46 user nova-compute[75113]: </domain>
Oct 26 16:55:46 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:55:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1886833755',display_name='tempest-VolumesSnapshotTestJSON-instance-1886833755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1886833755',id=9,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsgiw9wwZEneAl2mGFhjiCMItq1om3KMF6mUaG0y8H8ZdzGadtV3YxhKn8BVayd0I2FOR1jLrftT6sJD7K3U2MkmzyxF4ofuu9zfpA2yNaFE6yRLAaivNc8tdRotKPstg==',key_name='tempest-keypair-163189256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49e6333344bf4cc6904e13f9fbe6005f',ramdisk_id='',reservation_id='r-wthxvkl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1537589693',owner_user_name='tempest-VolumesSnapshotTestJSON-1537589693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22531c3975dc4e29ab0e7be404592d01',uuid=a8368686-8c4d-4373-a3a5-4498e2086e0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52953b56-70f6-4307-9368-7622665234cb", "address": "fa:16:3e:ef:35:6f", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52953b56-70", "ovs_interfaceid": "52953b56-70f6-4307-9368-7622665234cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Converting VIF {"id": "52953b56-70f6-4307-9368-7622665234cb", "address": "fa:16:3e:ef:35:6f", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52953b56-70", "ovs_interfaceid": "52953b56-70f6-4307-9368-7622665234cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:35:6f,bridge_name='br-int',has_traffic_filtering=True,id=52953b56-70f6-4307-9368-7622665234cb,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52953b56-70') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG os_vif [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:35:6f,bridge_name='br-int',has_traffic_filtering=True,id=52953b56-70f6-4307-9368-7622665234cb,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52953b56-70') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '290ae005-ac15-52b8-9a11-5081bf810068', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52953b56-70, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52953b56-70, col_values=(('qos', UUID('9680e6d8-7ff7-4d2d-ba5f-3d05b285d772')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52953b56-70, col_values=(('external_ids', {'iface-id': '52953b56-70f6-4307-9368-7622665234cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:35:6f', 'vm-uuid': 'a8368686-8c4d-4373-a3a5-4498e2086e0d'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:46 user nova-compute[75113]: INFO os_vif [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:35:6f,bridge_name='br-int',has_traffic_filtering=True,id=52953b56-70f6-4307-9368-7622665234cb,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52953b56-70')
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] No VIF found with MAC fa:16:3e:ef:35:6f, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.network.neutron [req-7747f113-1224-4545-b0f4-e54f381d3bf2 req-db9922fa-e491-4437-890d-ca6059d33140 service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Updated VIF entry in instance network info cache for port 52953b56-70f6-4307-9368-7622665234cb. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG nova.network.neutron [req-7747f113-1224-4545-b0f4-e54f381d3bf2 req-db9922fa-e491-4437-890d-ca6059d33140 service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Updating instance_info_cache with network_info: [{"id": "52953b56-70f6-4307-9368-7622665234cb", "address": "fa:16:3e:ef:35:6f", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52953b56-70", "ovs_interfaceid": "52953b56-70f6-4307-9368-7622665234cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:55:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7747f113-1224-4545-b0f4-e54f381d3bf2 req-db9922fa-e491-4437-890d-ca6059d33140 service nova] Releasing lock "refresh_cache-a8368686-8c4d-4373-a3a5-4498e2086e0d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:55:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-48c860d2-c483-4752-83fe-0115286d8071 req-583a6531-398b-41f8-8a18-c41f36be3f3a service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Received event network-vif-plugged-52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-48c860d2-c483-4752-83fe-0115286d8071 req-583a6531-398b-41f8-8a18-c41f36be3f3a service nova] Acquiring lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-48c860d2-c483-4752-83fe-0115286d8071 req-583a6531-398b-41f8-8a18-c41f36be3f3a service nova] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-48c860d2-c483-4752-83fe-0115286d8071 req-583a6531-398b-41f8-8a18-c41f36be3f3a service nova] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-48c860d2-c483-4752-83fe-0115286d8071 req-583a6531-398b-41f8-8a18-c41f36be3f3a service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] No waiting events found dispatching network-vif-plugged-52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:55:48 user nova-compute[75113]: WARNING nova.compute.manager [req-48c860d2-c483-4752-83fe-0115286d8071 req-583a6531-398b-41f8-8a18-c41f36be3f3a service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Received unexpected event network-vif-plugged-52953b56-70f6-4307-9368-7622665234cb for instance with vm_state building and task_state spawning.
Oct 26 16:55:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:55:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:55:48 user nova-compute[75113]: INFO nova.compute.claims [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Claim successful on node user
Oct 26 16:55:49 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:55:49 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:55:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:55:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:55:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:55:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:55:49 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:55:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:55:49 user nova-compute[75113]: INFO nova.virt.block_device [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Booting with volume f451bb25-be49-4269-b788-16b1a0b42aac at /dev/vda
Oct 26 16:55:49 user nova-compute[75113]: DEBUG nova.policy [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7507eb0467eb48bb94804ed84e57a42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173647d78bcc49e3ba74a76991fdb619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:55:49 user nova-compute[75113]: DEBUG os_brick.utils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:55:49 user nova-compute[75113]: INFO oslo.privsep.daemon [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp9u7ueyan/privsep.sock']
Oct 26 16:55:49 user sudo[86600]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp9u7ueyan/privsep.sock
Oct 26 16:55:49 user sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Successfully created port: 5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:55:50 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Instance spawned successfully.
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-269d8d6e-404d-434a-891f-66058fd55d18 req-511ef78e-a3ec-433e-9880-a373a67ba818 service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Received event network-vif-plugged-52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-269d8d6e-404d-434a-891f-66058fd55d18 req-511ef78e-a3ec-433e-9880-a373a67ba818 service nova] Acquiring lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-269d8d6e-404d-434a-891f-66058fd55d18 req-511ef78e-a3ec-433e-9880-a373a67ba818 service nova] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-269d8d6e-404d-434a-891f-66058fd55d18 req-511ef78e-a3ec-433e-9880-a373a67ba818 service nova] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-269d8d6e-404d-434a-891f-66058fd55d18 req-511ef78e-a3ec-433e-9880-a373a67ba818 service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] No waiting events found dispatching network-vif-plugged-52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:55:50 user nova-compute[75113]: WARNING nova.compute.manager [req-269d8d6e-404d-434a-891f-66058fd55d18 req-511ef78e-a3ec-433e-9880-a373a67ba818 service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Received unexpected event network-vif-plugged-52953b56-70f6-4307-9368-7622665234cb for instance with vm_state building and task_state spawning.
Oct 26 16:55:50 user nova-compute[75113]: INFO nova.compute.manager [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Took 5.51 seconds to spawn the instance on the hypervisor.
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:55:50 user nova-compute[75113]: INFO nova.compute.manager [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Took 6.52 seconds to build instance.
Oct 26 16:55:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff9099b8-21bb-40d4-bbbd-394c24c8a45f tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.625s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:50 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Successfully created port: 2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:55:51 user sudo[86600]: pam_unix(sudo:session): session closed for user root
Oct 26 16:55:51 user nova-compute[75113]: INFO oslo.privsep.daemon [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Spawned new privsep daemon via rootwrap
Oct 26 16:55:51 user nova-compute[75113]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 16:55:51 user nova-compute[75113]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 16:55:51 user nova-compute[75113]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 26 16:55:51 user nova-compute[75113]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86603
Oct 26 16:55:51 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Successfully created port: 9d92159e-2ef5-43c8-bb24-9d0f73a875ac {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15786b4-b0b6-4b8e-9079-9e5fe6d86a3b]: (2,) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[672e05bb-ccbb-45f5-ba2c-4a03027f7b93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:55:51 user nova-compute[75113]: WARNING os_brick.initiator.connectors.nvmeof [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6844bd52-1b1c-4033-8342-19df9c3f5df0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf4ec31-ca8c-4258-92df-f029fc1f64d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ba1fc3-e225-4a2a-8657-abf37125146c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:55:51 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:55:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41617b3-b87a-463b-82a4-f212a17d61b0]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG os_brick.utils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] <== get_connector_properties: return (2191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:55:51 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating existing volume attachment record: 2760ec08-bd26-4f47-b3eb-7321dab4c9e6 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:55:52 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Successfully created port: d8d4dd71-2d05-4d5a-9818-dec95781dd73 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:55:53 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Successfully created port: d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:55:53 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:55:53 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Successfully updated port: 5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:55:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-d1ef1c30-ddfa-4d64-b712-ff0378decb44 req-5534f16e-40c6-4c7d-ac51-666ec4af08ca service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-changed-5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:55:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-d1ef1c30-ddfa-4d64-b712-ff0378decb44 req-5534f16e-40c6-4c7d-ac51-666ec4af08ca service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing instance network info cache due to event network-changed-5dbfd85e-684a-4c18-b660-7491fea99a4a. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:55:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1ef1c30-ddfa-4d64-b712-ff0378decb44 req-5534f16e-40c6-4c7d-ac51-666ec4af08ca service nova] Acquiring lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:55:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1ef1c30-ddfa-4d64-b712-ff0378decb44 req-5534f16e-40c6-4c7d-ac51-666ec4af08ca service nova] Acquired lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:55:53 user nova-compute[75113]: DEBUG nova.network.neutron [req-d1ef1c30-ddfa-4d64-b712-ff0378decb44 req-5534f16e-40c6-4c7d-ac51-666ec4af08ca service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing network info cache for port 5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:55:53 user nova-compute[75113]: DEBUG nova.network.neutron [req-d1ef1c30-ddfa-4d64-b712-ff0378decb44 req-5534f16e-40c6-4c7d-ac51-666ec4af08ca service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:55:53 user nova-compute[75113]: DEBUG nova.network.neutron [req-d1ef1c30-ddfa-4d64-b712-ff0378decb44 req-5534f16e-40c6-4c7d-ac51-666ec4af08ca service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:55:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1ef1c30-ddfa-4d64-b712-ff0378decb44 req-5534f16e-40c6-4c7d-ac51-666ec4af08ca service nova] Releasing lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:55:54 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:55:54 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:55:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:55:54 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Successfully updated port: 5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:55:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:55:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:55:54 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Successfully updated port: c46d4142-9e17-4a68-904c-f0ae8102ecc8 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating instance_info_cache with network_info: [{"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-changed-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing instance network info cache due to event network-changed-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] Acquiring lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] Acquired lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG nova.network.neutron [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing network info cache for port 5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Successfully updated port: 2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG nova.network.neutron [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-1dac58a2-3495-4a0b-abf0-cf33d882c02b req-0646d752-41cc-4720-ac66-04330aa8bcdf service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-changed-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-1dac58a2-3495-4a0b-abf0-cf33d882c02b req-0646d752-41cc-4720-ac66-04330aa8bcdf service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing instance network info cache due to event network-changed-2c2c1443-f57d-489a-a795-8ad1046af4c7. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:55:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1dac58a2-3495-4a0b-abf0-cf33d882c02b req-0646d752-41cc-4720-ac66-04330aa8bcdf service nova] Acquiring lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG nova.network.neutron [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] Releasing lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-changed-c46d4142-9e17-4a68-904c-f0ae8102ecc8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing instance network info cache due to event network-changed-c46d4142-9e17-4a68-904c-f0ae8102ecc8. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] Acquiring lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] Acquired lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG nova.network.neutron [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing network info cache for port c46d4142-9e17-4a68-904c-f0ae8102ecc8 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG nova.network.neutron [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG nova.network.neutron [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ed7a3b1c-2ecc-4986-be06-dc00d7a0e672 req-9a3f208f-490e-402b-8835-f5814426510e service nova] Releasing lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1dac58a2-3495-4a0b-abf0-cf33d882c02b req-0646d752-41cc-4720-ac66-04330aa8bcdf service nova] Acquired lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG nova.network.neutron [req-1dac58a2-3495-4a0b-abf0-cf33d882c02b req-0646d752-41cc-4720-ac66-04330aa8bcdf service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing network info cache for port 2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Successfully updated port: 9d92159e-2ef5-43c8-bb24-9d0f73a875ac {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG nova.network.neutron [req-1dac58a2-3495-4a0b-abf0-cf33d882c02b req-0646d752-41cc-4720-ac66-04330aa8bcdf service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:56 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG nova.network.neutron [req-1dac58a2-3495-4a0b-abf0-cf33d882c02b req-0646d752-41cc-4720-ac66-04330aa8bcdf service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1dac58a2-3495-4a0b-abf0-cf33d882c02b req-0646d752-41cc-4720-ac66-04330aa8bcdf service nova] Releasing lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Successfully updated port: d8d4dd71-2d05-4d5a-9818-dec95781dd73 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Successfully updated port: d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-changed-9d92159e-2ef5-43c8-bb24-9d0f73a875ac {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing instance network info cache due to event network-changed-9d92159e-2ef5-43c8-bb24-9d0f73a875ac. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] Acquiring lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] Acquired lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG nova.network.neutron [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing network info cache for port 9d92159e-2ef5-43c8-bb24-9d0f73a875ac {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-f2c93e6a-07f0-45de-97cf-abd7187d17ef req-d96f85bd-6d72-41b3-939a-9989166be70d service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-changed-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-f2c93e6a-07f0-45de-97cf-abd7187d17ef req-d96f85bd-6d72-41b3-939a-9989166be70d service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Refreshing instance network info cache due to event network-changed-96d708f7-00f7-44af-9bc6-43882921ea03. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f2c93e6a-07f0-45de-97cf-abd7187d17ef req-d96f85bd-6d72-41b3-939a-9989166be70d service nova] Acquiring lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f2c93e6a-07f0-45de-97cf-abd7187d17ef req-d96f85bd-6d72-41b3-939a-9989166be70d service nova] Acquired lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG nova.network.neutron [req-f2c93e6a-07f0-45de-97cf-abd7187d17ef req-d96f85bd-6d72-41b3-939a-9989166be70d service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Refreshing network info cache for port 96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:55:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] Releasing lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-changed-d8d4dd71-2d05-4d5a-9818-dec95781dd73 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing instance network info cache due to event network-changed-d8d4dd71-2d05-4d5a-9818-dec95781dd73. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] Acquiring lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] Acquired lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing network info cache for port d8d4dd71-2d05-4d5a-9818-dec95781dd73 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1a8dc94-2196-4179-8dde-b1351e66dbab req-9b81b84d-03fe-4556-877f-69008aafba47 service nova] Releasing lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquired lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-f2c93e6a-07f0-45de-97cf-abd7187d17ef req-d96f85bd-6d72-41b3-939a-9989166be70d service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updated VIF entry in instance network info cache for port 96d708f7-00f7-44af-9bc6-43882921ea03. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-f2c93e6a-07f0-45de-97cf-abd7187d17ef req-d96f85bd-6d72-41b3-939a-9989166be70d service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating instance_info_cache with network_info: [{"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f2c93e6a-07f0-45de-97cf-abd7187d17ef req-d96f85bd-6d72-41b3-939a-9989166be70d service nova] Releasing lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:55:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:55:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:55:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-8d08c3b0-7950-4dca-8d74-47100d7ee50b req-1a929803-eeaf-4c1e-8450-28f5972df4ca service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-changed-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:56:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-8d08c3b0-7950-4dca-8d74-47100d7ee50b req-1a929803-eeaf-4c1e-8450-28f5972df4ca service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing instance network info cache due to event network-changed-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:56:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8d08c3b0-7950-4dca-8d74-47100d7ee50b req-1a929803-eeaf-4c1e-8450-28f5972df4ca service nova] Acquiring lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:56:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-ea34cb6f-164b-4adc-81fb-c35c4c69831c req-9b26affc-1714-43db-92a1-6d725898bc38 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-changed-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:56:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-ea34cb6f-164b-4adc-81fb-c35c4c69831c req-9b26affc-1714-43db-92a1-6d725898bc38 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Refreshing instance network info cache due to event network-changed-0502d8bd-666e-4f27-8c38-e060b44ce264. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:56:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ea34cb6f-164b-4adc-81fb-c35c4c69831c req-9b26affc-1714-43db-92a1-6d725898bc38 service nova] Acquiring lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:56:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ea34cb6f-164b-4adc-81fb-c35c4c69831c req-9b26affc-1714-43db-92a1-6d725898bc38 service nova] Acquired lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:56:00 user nova-compute[75113]: DEBUG nova.network.neutron [req-ea34cb6f-164b-4adc-81fb-c35c4c69831c req-9b26affc-1714-43db-92a1-6d725898bc38 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Refreshing network info cache for port 0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:56:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:01 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:56:01 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7298MB free_disk=25.509376525878906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ea7b1250-2387-491b-ac27-e1d3d27a13d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 645deae0-4c03-41d0-aa3b-daa79ed25425 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 69ed2396-a603-4c84-a66b-7b474523b68e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance f1769d95-897b-4e83-89ba-c486aa086dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance af957c0b-a655-4b55-974a-70256a760d3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fbf1e605-91c5-4188-9081-f9762ad92a9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e632e8ad-6d44-4a57-a04b-342bdf513260 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9064edf2-de11-4223-baed-d346bfe34fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance a8368686-8c4d-4373-a3a5-4498e2086e0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 8d18f293-ebac-4392-9405-869a7e23f3e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.network.neutron [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating instance_info_cache with network_info: [{"id": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "address": "fa:16:3e:5e:8d:bb", "network": {"id": "c2e7c5c6-ced3-44f1-baed-3115ab05a814", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-903346093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbfd85e-68", "ovs_interfaceid": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "address": "fa:16:3e:b0:1c:4e", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ec1e1-94", "ovs_interfaceid": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "address": "fa:16:3e:66:64:d7", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46d4142-9e", "ovs_interfaceid": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "address": "fa:16:3e:c8:73:3b", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2c1443-f5", "ovs_interfaceid": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "address": "fa:16:3e:09:04:3c", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d92159e-2e", "ovs_interfaceid": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "address": "fa:16:3e:0d:40:0f", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d4dd71-2d", "ovs_interfaceid": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "address": "fa:16:3e:dc:3e:7d", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4355f4f-05", "ovs_interfaceid": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Releasing lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Instance network_info: |[{"id": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "address": "fa:16:3e:5e:8d:bb", "network": {"id": "c2e7c5c6-ced3-44f1-baed-3115ab05a814", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-903346093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbfd85e-68", "ovs_interfaceid": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "address": "fa:16:3e:b0:1c:4e", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ec1e1-94", "ovs_interfaceid": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "address": "fa:16:3e:66:64:d7", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46d4142-9e", "ovs_interfaceid": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "address": "fa:16:3e:c8:73:3b", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2c1443-f5", "ovs_interfaceid": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "address": "fa:16:3e:09:04:3c", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d92159e-2e", "ovs_interfaceid": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "address": "fa:16:3e:0d:40:0f", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d4dd71-2d", "ovs_interfaceid": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "address": "fa:16:3e:dc:3e:7d", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4355f4f-05", "ovs_interfaceid": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8d08c3b0-7950-4dca-8d74-47100d7ee50b req-1a929803-eeaf-4c1e-8450-28f5972df4ca service nova] Acquired lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.network.neutron [req-8d08c3b0-7950-4dca-8d74-47100d7ee50b req-1a929803-eeaf-4c1e-8450-28f5972df4ca service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing network info cache for port d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.network.neutron [req-ea34cb6f-164b-4adc-81fb-c35c4c69831c req-9b26affc-1714-43db-92a1-6d725898bc38 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updated VIF entry in instance network info cache for port 0502d8bd-666e-4f27-8c38-e060b44ce264. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.network.neutron [req-ea34cb6f-164b-4adc-81fb-c35c4c69831c req-9b26affc-1714-43db-92a1-6d725898bc38 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updating instance_info_cache with network_info: [{"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ea34cb6f-164b-4adc-81fb-c35c4c69831c req-9b26affc-1714-43db-92a1-6d725898bc38 service nova] Releasing lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:56:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:56:02 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:56:02 user nova-compute[75113]: INFO nova.compute.manager [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] instance snapshotting
Oct 26 16:56:02 user nova-compute[75113]: DEBUG nova.network.neutron [req-8d08c3b0-7950-4dca-8d74-47100d7ee50b req-1a929803-eeaf-4c1e-8450-28f5972df4ca service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updated VIF entry in instance network info cache for port d4355f4f-05b7-4b2e-afe4-af2377a4f4b6. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:56:02 user nova-compute[75113]: DEBUG nova.network.neutron [req-8d08c3b0-7950-4dca-8d74-47100d7ee50b req-1a929803-eeaf-4c1e-8450-28f5972df4ca service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating instance_info_cache with network_info: [{"id": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "address": "fa:16:3e:5e:8d:bb", "network": {"id": "c2e7c5c6-ced3-44f1-baed-3115ab05a814", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-903346093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbfd85e-68", "ovs_interfaceid": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "address": "fa:16:3e:b0:1c:4e", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ec1e1-94", "ovs_interfaceid": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "address": "fa:16:3e:66:64:d7", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46d4142-9e", "ovs_interfaceid": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "address": "fa:16:3e:c8:73:3b", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2c1443-f5", "ovs_interfaceid": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "address": "fa:16:3e:09:04:3c", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d92159e-2e", "ovs_interfaceid": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "address": "fa:16:3e:0d:40:0f", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d4dd71-2d", "ovs_interfaceid": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "address": "fa:16:3e:dc:3e:7d", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4355f4f-05", "ovs_interfaceid": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:56:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8d08c3b0-7950-4dca-8d74-47100d7ee50b req-1a929803-eeaf-4c1e-8450-28f5972df4ca service nova] Releasing lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:56:02 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Beginning live snapshot process
Oct 26 16:56:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json -f qcow2 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:02 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lazy-loading 'flavor' on Instance uuid ea7b1250-2387-491b-ac27-e1d3d27a13d2 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:56:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json -f qcow2" returned: 0 in 0.259s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json -f qcow2 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.176s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:03 user nova-compute[75113]: INFO nova.compute.manager [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Attaching volume 80a2de16-30c8-4666-ac97-9406d443d446 to /dev/vdb
Oct 26 16:56:03 user nova-compute[75113]: DEBUG os_brick.utils [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.206s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc8pr935l/7a778517f4b748499949c24bfde31a99.delta 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f91cd5-5589-4085-b4d4-8ba24abae301]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc8pr935l/7a778517f4b748499949c24bfde31a99.delta 1073741824" returned: 0 in 0.071s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:03 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[332422fa-f5b1-4b13-ac03-c09dfa7667df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75113) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 26 16:56:03 user nova-compute[75113]: INFO nova.virt.libvirt.host [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] UEFI support detected
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[74877937-56c2-480d-bfe5-44667d0ff94d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[058ff87b-10d2-4714-b7a4-e10e628fcf3e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:56:03 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f63dbd-402b-4aef-b943-e766f72d04d7]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG os_brick.utils [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Updating existing volume attachment record: 896a91e3-8a01-43f4-b324-3d7433b47093 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:56:03 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:56:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 16:56:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 16:56:04 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 16:56:04 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 16:56:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc8pr935l/7a778517f4b748499949c24bfde31a99.delta /opt/stack/data/nova/instances/snapshots/tmpc8pr935l/7a778517f4b748499949c24bfde31a99 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc8pr935l/7a778517f4b748499949c24bfde31a99.delta /opt/stack/data/nova/instances/snapshots/tmpc8pr935l/7a778517f4b748499949c24bfde31a99" returned: 0 in 0.342s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:05 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Snapshot extracted, beginning image upload
Oct 26 16:56:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:07 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Snapshot image upload complete
Oct 26 16:56:07 user nova-compute[75113]: INFO nova.compute.manager [None req-cc7a1350-d695-4aa9-967a-757b8f512a45 tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Took 5.71 seconds to snapshot the instance on the hypervisor.
Oct 26 16:56:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-42cbed80-758b-4cfb-9a4f-56659ddf3ec4 req-fe7b72ee-3a09-4ba2-bfa5-21d8511cad85 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Received event network-changed-8af075bf-d8dd-478d-9f83-3faf420bc6c6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:56:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-42cbed80-758b-4cfb-9a4f-56659ddf3ec4 req-fe7b72ee-3a09-4ba2-bfa5-21d8511cad85 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Refreshing instance network info cache due to event network-changed-8af075bf-d8dd-478d-9f83-3faf420bc6c6. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:56:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-42cbed80-758b-4cfb-9a4f-56659ddf3ec4 req-fe7b72ee-3a09-4ba2-bfa5-21d8511cad85 service nova] Acquiring lock "refresh_cache-f1769d95-897b-4e83-89ba-c486aa086dc1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:56:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-42cbed80-758b-4cfb-9a4f-56659ddf3ec4 req-fe7b72ee-3a09-4ba2-bfa5-21d8511cad85 service nova] Acquired lock "refresh_cache-f1769d95-897b-4e83-89ba-c486aa086dc1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:56:18 user nova-compute[75113]: DEBUG nova.network.neutron [req-42cbed80-758b-4cfb-9a4f-56659ddf3ec4 req-fe7b72ee-3a09-4ba2-bfa5-21d8511cad85 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Refreshing network info cache for port 8af075bf-d8dd-478d-9f83-3faf420bc6c6 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:56:19 user nova-compute[75113]: DEBUG nova.network.neutron [req-42cbed80-758b-4cfb-9a4f-56659ddf3ec4 req-fe7b72ee-3a09-4ba2-bfa5-21d8511cad85 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Updated VIF entry in instance network info cache for port 8af075bf-d8dd-478d-9f83-3faf420bc6c6. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:56:19 user nova-compute[75113]: DEBUG nova.network.neutron [req-42cbed80-758b-4cfb-9a4f-56659ddf3ec4 req-fe7b72ee-3a09-4ba2-bfa5-21d8511cad85 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Updating instance_info_cache with network_info: [{"id": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "address": "fa:16:3e:54:a8:27", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af075bf-d8", "ovs_interfaceid": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:56:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-42cbed80-758b-4cfb-9a4f-56659ddf3ec4 req-fe7b72ee-3a09-4ba2-bfa5-21d8511cad85 service nova] Releasing lock "refresh_cache-f1769d95-897b-4e83-89ba-c486aa086dc1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:56:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:23 user nova-compute[75113]: DEBUG nova.compute.manager [req-e2f76b8a-1726-473b-a1aa-596fe6325040 req-60f37eba-3fce-4677-a09e-88cbd97cccf3 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Received event network-changed-39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:56:23 user nova-compute[75113]: DEBUG nova.compute.manager [req-e2f76b8a-1726-473b-a1aa-596fe6325040 req-60f37eba-3fce-4677-a09e-88cbd97cccf3 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Refreshing instance network info cache due to event network-changed-39dbc0a5-bfeb-47fc-993b-06de27422f03. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:56:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e2f76b8a-1726-473b-a1aa-596fe6325040 req-60f37eba-3fce-4677-a09e-88cbd97cccf3 service nova] Acquiring lock "refresh_cache-af957c0b-a655-4b55-974a-70256a760d3c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:56:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e2f76b8a-1726-473b-a1aa-596fe6325040 req-60f37eba-3fce-4677-a09e-88cbd97cccf3 service nova] Acquired lock "refresh_cache-af957c0b-a655-4b55-974a-70256a760d3c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:56:23 user nova-compute[75113]: DEBUG nova.network.neutron [req-e2f76b8a-1726-473b-a1aa-596fe6325040 req-60f37eba-3fce-4677-a09e-88cbd97cccf3 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Refreshing network info cache for port 39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:56:23 user nova-compute[75113]: DEBUG nova.network.neutron [req-e2f76b8a-1726-473b-a1aa-596fe6325040 req-60f37eba-3fce-4677-a09e-88cbd97cccf3 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Updated VIF entry in instance network info cache for port 39dbc0a5-bfeb-47fc-993b-06de27422f03. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:56:23 user nova-compute[75113]: DEBUG nova.network.neutron [req-e2f76b8a-1726-473b-a1aa-596fe6325040 req-60f37eba-3fce-4677-a09e-88cbd97cccf3 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Updating instance_info_cache with network_info: [{"id": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "address": "fa:16:3e:8a:91:a9", "network": {"id": "c18bc66f-1d7e-41b4-b583-fce9e5d78cd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1141220283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17a0645348045aa82d80f7291a44d3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39dbc0a5-bf", "ovs_interfaceid": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:56:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e2f76b8a-1726-473b-a1aa-596fe6325040 req-60f37eba-3fce-4677-a09e-88cbd97cccf3 service nova] Releasing lock "refresh_cache-af957c0b-a655-4b55-974a-70256a760d3c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:56:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-4cea07d1-4c35-4eeb-8c9c-650c16a65953 req-0213bebb-c74a-4538-857e-d15794283335 service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Received event network-changed-02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:56:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-4cea07d1-4c35-4eeb-8c9c-650c16a65953 req-0213bebb-c74a-4538-857e-d15794283335 service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Refreshing instance network info cache due to event network-changed-02278050-c73c-493a-83c4-095f43697e9f. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:56:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4cea07d1-4c35-4eeb-8c9c-650c16a65953 req-0213bebb-c74a-4538-857e-d15794283335 service nova] Acquiring lock "refresh_cache-fbf1e605-91c5-4188-9081-f9762ad92a9f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:56:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4cea07d1-4c35-4eeb-8c9c-650c16a65953 req-0213bebb-c74a-4538-857e-d15794283335 service nova] Acquired lock "refresh_cache-fbf1e605-91c5-4188-9081-f9762ad92a9f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:56:25 user nova-compute[75113]: DEBUG nova.network.neutron [req-4cea07d1-4c35-4eeb-8c9c-650c16a65953 req-0213bebb-c74a-4538-857e-d15794283335 service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Refreshing network info cache for port 02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:56:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:25 user nova-compute[75113]: DEBUG nova.objects.instance [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lazy-loading 'flavor' on Instance uuid fbf1e605-91c5-4188-9081-f9762ad92a9f {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:56:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG nova.network.neutron [req-4cea07d1-4c35-4eeb-8c9c-650c16a65953 req-0213bebb-c74a-4538-857e-d15794283335 service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Updated VIF entry in instance network info cache for port 02278050-c73c-493a-83c4-095f43697e9f. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG nova.network.neutron [req-4cea07d1-4c35-4eeb-8c9c-650c16a65953 req-0213bebb-c74a-4538-857e-d15794283335 service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Updating instance_info_cache with network_info: [{"id": "02278050-c73c-493a-83c4-095f43697e9f", "address": "fa:16:3e:dc:3d:4b", "network": {"id": "04d9fbd9-4ccd-424a-ac46-2324eac68387", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1918515909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee6a73f02e54d7fa20bbe92d986f577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02278050-c7", "ovs_interfaceid": "02278050-c73c-493a-83c4-095f43697e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4cea07d1-4c35-4eeb-8c9c-650c16a65953 req-0213bebb-c74a-4538-857e-d15794283335 service nova] Releasing lock "refresh_cache-fbf1e605-91c5-4188-9081-f9762ad92a9f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:26 user nova-compute[75113]: INFO nova.compute.manager [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Attaching volume 92367020-5467-406a-bff3-0089938acf08 to /dev/vdb
Oct 26 16:56:26 user nova-compute[75113]: DEBUG os_brick.utils [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abec082-b79d-4aef-9e06-78e41cfbf243]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84392ac-9f37-43b4-85f3-53af4f98e8c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f070e9-f777-4fef-a491-8bd8bd31b11d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b691f6-1157-4eff-9faa-3c339bb08322]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:56:26 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:56:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a3fc7c-e546-4195-88b4-77192c92be57]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG os_brick.utils [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Updating existing volume attachment record: 46ca389b-10a8-4630-8f90-a656986b6971 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:56:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-fea2dea9-2fd8-490b-a385-e187ca5c983d req-9760113d-03c5-4a13-9135-4af8f9dc1595 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Received event network-changed-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:56:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-fea2dea9-2fd8-490b-a385-e187ca5c983d req-9760113d-03c5-4a13-9135-4af8f9dc1595 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Refreshing instance network info cache due to event network-changed-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:56:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fea2dea9-2fd8-490b-a385-e187ca5c983d req-9760113d-03c5-4a13-9135-4af8f9dc1595 service nova] Acquiring lock "refresh_cache-e632e8ad-6d44-4a57-a04b-342bdf513260" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:56:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fea2dea9-2fd8-490b-a385-e187ca5c983d req-9760113d-03c5-4a13-9135-4af8f9dc1595 service nova] Acquired lock "refresh_cache-e632e8ad-6d44-4a57-a04b-342bdf513260" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:56:27 user nova-compute[75113]: DEBUG nova.network.neutron [req-fea2dea9-2fd8-490b-a385-e187ca5c983d req-9760113d-03c5-4a13-9135-4af8f9dc1595 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Refreshing network info cache for port 3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:56:28 user nova-compute[75113]: DEBUG nova.network.neutron [req-fea2dea9-2fd8-490b-a385-e187ca5c983d req-9760113d-03c5-4a13-9135-4af8f9dc1595 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Updated VIF entry in instance network info cache for port 3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:56:28 user nova-compute[75113]: DEBUG nova.network.neutron [req-fea2dea9-2fd8-490b-a385-e187ca5c983d req-9760113d-03c5-4a13-9135-4af8f9dc1595 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Updating instance_info_cache with network_info: [{"id": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "address": "fa:16:3e:8a:01:23", "network": {"id": "36a5fd04-a05e-4e2c-931a-f186ee527b78", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-577328747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154d6bc4a64448cba3150f04e0d5834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb4bd76-9c", "ovs_interfaceid": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:56:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fea2dea9-2fd8-490b-a385-e187ca5c983d req-9760113d-03c5-4a13-9135-4af8f9dc1595 service nova] Releasing lock "refresh_cache-e632e8ad-6d44-4a57-a04b-342bdf513260" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:56:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-58032209-6b1d-492e-a28a-e7e1c91f4d57 req-0fc1d126-e5ac-4633-be92-e9bd2032c1c7 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-changed-b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:56:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-58032209-6b1d-492e-a28a-e7e1c91f4d57 req-0fc1d126-e5ac-4633-be92-e9bd2032c1c7 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Refreshing instance network info cache due to event network-changed-b55efe74-8efe-4e0d-a917-a9c47cae9a85. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:56:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-58032209-6b1d-492e-a28a-e7e1c91f4d57 req-0fc1d126-e5ac-4633-be92-e9bd2032c1c7 service nova] Acquiring lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:56:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-58032209-6b1d-492e-a28a-e7e1c91f4d57 req-0fc1d126-e5ac-4633-be92-e9bd2032c1c7 service nova] Acquired lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:56:33 user nova-compute[75113]: DEBUG nova.network.neutron [req-58032209-6b1d-492e-a28a-e7e1c91f4d57 req-0fc1d126-e5ac-4633-be92-e9bd2032c1c7 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Refreshing network info cache for port b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:56:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "interface-9064edf2-de11-4223-baed-d346bfe34fcc-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "interface-9064edf2-de11-4223-baed-d346bfe34fcc-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:33 user nova-compute[75113]: DEBUG nova.objects.instance [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lazy-loading 'flavor' on Instance uuid 9064edf2-de11-4223-baed-d346bfe34fcc {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:56:33 user nova-compute[75113]: DEBUG nova.network.neutron [req-58032209-6b1d-492e-a28a-e7e1c91f4d57 req-0fc1d126-e5ac-4633-be92-e9bd2032c1c7 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Updated VIF entry in instance network info cache for port b55efe74-8efe-4e0d-a917-a9c47cae9a85. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:56:33 user nova-compute[75113]: DEBUG nova.network.neutron [req-58032209-6b1d-492e-a28a-e7e1c91f4d57 req-0fc1d126-e5ac-4633-be92-e9bd2032c1c7 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Updating instance_info_cache with network_info: [{"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:56:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-58032209-6b1d-492e-a28a-e7e1c91f4d57 req-0fc1d126-e5ac-4633-be92-e9bd2032c1c7 service nova] Releasing lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:56:34 user nova-compute[75113]: DEBUG nova.objects.instance [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lazy-loading 'pci_requests' on Instance uuid 9064edf2-de11-4223-baed-d346bfe34fcc {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:56:34 user nova-compute[75113]: DEBUG nova.objects.base [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Object Instance<9064edf2-de11-4223-baed-d346bfe34fcc> lazy-loaded attributes: flavor,pci_requests {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:56:34 user nova-compute[75113]: DEBUG nova.network.neutron [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:56:34 user nova-compute[75113]: DEBUG nova.policy [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3b34c772fc54da89ff6787f12fef797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c7a88071a24c96abb06407c59a2775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:56:34 user nova-compute[75113]: DEBUG nova.network.neutron [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Successfully created port: 528921b8-dc12-49ae-844c-26313949e09e {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG nova.network.neutron [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Successfully updated port: 528921b8-dc12-49ae-844c-26313949e09e {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquired lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG nova.network.neutron [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG nova.compute.manager [req-89ab4314-3cd2-47e7-a4a5-e4428f3b430c req-5694ac34-b9b0-48e8-a30a-311b4b75fb20 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-changed-528921b8-dc12-49ae-844c-26313949e09e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG nova.compute.manager [req-89ab4314-3cd2-47e7-a4a5-e4428f3b430c req-5694ac34-b9b0-48e8-a30a-311b4b75fb20 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Refreshing instance network info cache due to event network-changed-528921b8-dc12-49ae-844c-26313949e09e. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-89ab4314-3cd2-47e7-a4a5-e4428f3b430c req-5694ac34-b9b0-48e8-a30a-311b4b75fb20 service nova] Acquiring lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG nova.network.neutron [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Updating instance_info_cache with network_info: [{"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Releasing lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-89ab4314-3cd2-47e7-a4a5-e4428f3b430c req-5694ac34-b9b0-48e8-a30a-311b4b75fb20 service nova] Acquired lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG nova.network.neutron [req-89ab4314-3cd2-47e7-a4a5-e4428f3b430c req-5694ac34-b9b0-48e8-a30a-311b4b75fb20 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Refreshing network info cache for port 528921b8-dc12-49ae-844c-26313949e09e {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1384773775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1384773775',id=8,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESp5K/14Ggl6vrqYPJZwPerrbYDesNlYVE2P8OiIAmeuCFyfagPIf0wDUE44PKomsOLEBGK5zvmXNCoV246gjfXa+oGWMEfMNs4yKfAzQiMGQTrxjH+/YVUO6sO4X+6vw==',key_name='tempest-keypair-1710846497',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='87c7a88071a24c96abb06407c59a2775',ramdisk_id='',reservation_id='r-0pxw2si0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-508694228',owner_user_name='tempest-TaggedAttachmentsTest-508694228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3b34c772fc54da89ff6787f12fef797',uuid=9064edf2-de11-4223-baed-d346bfe34fcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converting VIF {"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:25:b9,bridge_name='br-int',has_traffic_filtering=True,id=528921b8-dc12-49ae-844c-26313949e09e,network=Network(891dc6b2-cbc0-4f37-b84b-0e618790a183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528921b8-dc') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG os_vif [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:25:b9,bridge_name='br-int',has_traffic_filtering=True,id=528921b8-dc12-49ae-844c-26313949e09e,network=Network(891dc6b2-cbc0-4f37-b84b-0e618790a183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528921b8-dc') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b874d98-db36-53ff-aec4-823fc61e0ff7', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap528921b8-dc, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap528921b8-dc, col_values=(('qos', UUID('f4ebc7a1-c026-4411-8ee6-48c5b85c6288')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap528921b8-dc, col_values=(('external_ids', {'iface-id': '528921b8-dc12-49ae-844c-26313949e09e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:25:b9', 'vm-uuid': '9064edf2-de11-4223-baed-d346bfe34fcc'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:35 user nova-compute[75113]: INFO os_vif [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:25:b9,bridge_name='br-int',has_traffic_filtering=True,id=528921b8-dc12-49ae-844c-26313949e09e,network=Network(891dc6b2-cbc0-4f37-b84b-0e618790a183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528921b8-dc')
Oct 26 16:56:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1384773775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1384773775',id=8,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESp5K/14Ggl6vrqYPJZwPerrbYDesNlYVE2P8OiIAmeuCFyfagPIf0wDUE44PKomsOLEBGK5zvmXNCoV246gjfXa+oGWMEfMNs4yKfAzQiMGQTrxjH+/YVUO6sO4X+6vw==',key_name='tempest-keypair-1710846497',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='87c7a88071a24c96abb06407c59a2775',ramdisk_id='',reservation_id='r-0pxw2si0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-508694228',owner_user_name='tempest-TaggedAttachmentsTest-508694228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3b34c772fc54da89ff6787f12fef797',uuid=9064edf2-de11-4223-baed-d346bfe34fcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converting VIF {"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:25:b9,bridge_name='br-int',has_traffic_filtering=True,id=528921b8-dc12-49ae-844c-26313949e09e,network=Network(891dc6b2-cbc0-4f37-b84b-0e618790a183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528921b8-dc') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] attach device xml: <interface type="ethernet">
Oct 26 16:56:35 user nova-compute[75113]:   <mac address="fa:16:3e:79:25:b9"/>
Oct 26 16:56:35 user nova-compute[75113]:   <model type="virtio"/>
Oct 26 16:56:35 user nova-compute[75113]:   <mtu size="1442"/>
Oct 26 16:56:35 user nova-compute[75113]:   <target dev="tap528921b8-dc"/>
Oct 26 16:56:35 user nova-compute[75113]: </interface>
Oct 26 16:56:35 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:56:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] No BDM found with device name hda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:56:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] No VIF found with MAC fa:16:3e:84:a4:ac, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:56:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:56:36 user nova-compute[75113]:   <nova:package version="0.0.0"/>
Oct 26 16:56:36 user nova-compute[75113]:   <nova:name>tempest-device-tagging-server-1384773775</nova:name>
Oct 26 16:56:36 user nova-compute[75113]:   <nova:creationTime>2023-10-26 16:56:36</nova:creationTime>
Oct 26 16:56:36 user nova-compute[75113]:   <nova:flavor name="m1.tiny">
Oct 26 16:56:36 user nova-compute[75113]:     <nova:memory>512</nova:memory>
Oct 26 16:56:36 user nova-compute[75113]:     <nova:disk>1</nova:disk>
Oct 26 16:56:36 user nova-compute[75113]:     <nova:swap>0</nova:swap>
Oct 26 16:56:36 user nova-compute[75113]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:56:36 user nova-compute[75113]:     <nova:vcpus>1</nova:vcpus>
Oct 26 16:56:36 user nova-compute[75113]:   </nova:flavor>
Oct 26 16:56:36 user nova-compute[75113]:   <nova:owner>
Oct 26 16:56:36 user nova-compute[75113]:     <nova:user uuid="c3b34c772fc54da89ff6787f12fef797">tempest-TaggedAttachmentsTest-508694228-project-member</nova:user>
Oct 26 16:56:36 user nova-compute[75113]:     <nova:project uuid="87c7a88071a24c96abb06407c59a2775">tempest-TaggedAttachmentsTest-508694228</nova:project>
Oct 26 16:56:36 user nova-compute[75113]:   </nova:owner>
Oct 26 16:56:36 user nova-compute[75113]:   <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:56:36 user nova-compute[75113]:   <nova:ports>
Oct 26 16:56:36 user nova-compute[75113]:     <nova:port uuid="b55efe74-8efe-4e0d-a917-a9c47cae9a85">
Oct 26 16:56:36 user nova-compute[75113]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 16:56:36 user nova-compute[75113]:     </nova:port>
Oct 26 16:56:36 user nova-compute[75113]:     <nova:port uuid="528921b8-dc12-49ae-844c-26313949e09e">
Oct 26 16:56:36 user nova-compute[75113]:       <nova:ip type="fixed" address="10.10.10.18" ipVersion="4"/>
Oct 26 16:56:36 user nova-compute[75113]:     </nova:port>
Oct 26 16:56:36 user nova-compute[75113]:   </nova:ports>
Oct 26 16:56:36 user nova-compute[75113]: </nova:instance>
Oct 26 16:56:36 user nova-compute[75113]:  {{(pid=75113) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 16:56:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81932717-fc27-4c7e-accd-fe0c5787c225 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "interface-9064edf2-de11-4223-baed-d346bfe34fcc-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.414s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:56:36 user nova-compute[75113]: DEBUG nova.network.neutron [req-89ab4314-3cd2-47e7-a4a5-e4428f3b430c req-5694ac34-b9b0-48e8-a30a-311b4b75fb20 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Updated VIF entry in instance network info cache for port 528921b8-dc12-49ae-844c-26313949e09e. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:56:36 user nova-compute[75113]: DEBUG nova.network.neutron [req-89ab4314-3cd2-47e7-a4a5-e4428f3b430c req-5694ac34-b9b0-48e8-a30a-311b4b75fb20 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Updating instance_info_cache with network_info: [{"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:56:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-89ab4314-3cd2-47e7-a4a5-e4428f3b430c req-5694ac34-b9b0-48e8-a30a-311b4b75fb20 service nova] Releasing lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:56:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connector [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Factory for ISCSI on None {{(pid=75113) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLMIiScs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:56:37 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:56:37 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:56:37 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[857b69af-60bf-474a-b543-1872e4088674]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:56:37 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa6857b-04f5-4d8d-b45f-82a429a88284]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446] added
Oct 26 16:56:37 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c431dd44-b923-4dd9-9653-5719f24304eb]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4c4482-e628-4949-bcff-a2b41e643b83]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLMIiScs {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Acquiring lock "e632e8ad-6d44-4a57-a04b-342bdf513260" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLMIiScs" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[431a2c7e-fc96-4215-8b40-a1a20b5f9999]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG nova.objects.instance [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lazy-loading 'flavor' on Instance uuid e632e8ad-6d44-4a57-a04b-342bdf513260 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XLMIiScs'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2830432-bf19-48cf-a6d9-3708756c0b3b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "9064edf2-de11-4223-baed-d346bfe34fcc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG nova.objects.instance [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lazy-loading 'flavor' on Instance uuid 9064edf2-de11-4223-baed-d346bfe34fcc {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a98bc9d-cc9b-4f4f-9d24-033c771a66be]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 16:56:37 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 16:56:37 user nova-compute[75113]:  {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:56:37 user nova-compute[75113]: WARNING os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 16:56:37 user nova-compute[75113]: 
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: INFO nova.virt.block_device [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Booting with volume 9241a060-213c-4215-8885-59d29315ca6f at /dev/vdb
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.129s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c066ca5d-01a1-4b8d-9ea7-923111c39fd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446, portal: 172.16.0.220,3260]
Oct 26 16:56:37 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446, portal: 172.16.0.220,3260] successful.
Oct 26 16:56:37 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "9064edf2-de11-4223-baed-d346bfe34fcc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[61477cda-76ea-4d58-b4d1-34ee5c976fbe]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b870428e-1ff5-4535-96e5-cd897e1201e4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)
Oct 26 16:56:37 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)
Oct 26 16:56:37 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "f1769d95-897b-4e83-89ba-c486aa086dc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG nova.objects.instance [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lazy-loading 'flavor' on Instance uuid f1769d95-897b-4e83-89ba-c486aa086dc1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc8dcb0-b49d-4941-9375-4cc5f02c44af]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLMIiScs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.utils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8397ea5-8d71-4ea6-8ced-b886c6f6d121]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4798bce5-49ac-44e1-aeb4-0e704e2b68ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a31233-aeeb-490f-97fb-cd651861a835]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67b0872-213f-42ad-80c1-c3cda7f5f735]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:56:37 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[79385a49-ed46-442d-b135-bd0dea7d3025]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG os_brick.utils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating existing volume attachment record: 341ab95b-7cdb-456b-b5d7-6925bdb367b5 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "9064edf2-de11-4223-baed-d346bfe34fcc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:37 user nova-compute[75113]: INFO nova.compute.manager [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Attaching volume 39c02300-9bdc-4407-af6b-163ff3803a7f to /dev/vdb
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Acquiring lock "e632e8ad-6d44-4a57-a04b-342bdf513260" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:37 user nova-compute[75113]: INFO nova.compute.manager [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Attaching volume 389de90c-9f08-4f96-aa61-6e14d723a2b8 to /dev/vdb
Oct 26 16:56:37 user nova-compute[75113]: DEBUG nova.compute.manager [req-921bc6ab-c08e-4e39-b364-2884d45aef67 req-d0579035-190f-420d-9f24-bbed7a23aeb7 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-vif-plugged-528921b8-dc12-49ae-844c-26313949e09e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-921bc6ab-c08e-4e39-b364-2884d45aef67 req-d0579035-190f-420d-9f24-bbed7a23aeb7 service nova] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-921bc6ab-c08e-4e39-b364-2884d45aef67 req-d0579035-190f-420d-9f24-bbed7a23aeb7 service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-921bc6ab-c08e-4e39-b364-2884d45aef67 req-d0579035-190f-420d-9f24-bbed7a23aeb7 service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG nova.compute.manager [req-921bc6ab-c08e-4e39-b364-2884d45aef67 req-d0579035-190f-420d-9f24-bbed7a23aeb7 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] No waiting events found dispatching network-vif-plugged-528921b8-dc12-49ae-844c-26313949e09e {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:56:37 user nova-compute[75113]: WARNING nova.compute.manager [req-921bc6ab-c08e-4e39-b364-2884d45aef67 req-d0579035-190f-420d-9f24-bbed7a23aeb7 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received unexpected event network-vif-plugged-528921b8-dc12-49ae-844c-26313949e09e for instance with vm_state active and task_state None.
Oct 26 16:56:37 user nova-compute[75113]: DEBUG nova.compute.manager [req-921bc6ab-c08e-4e39-b364-2884d45aef67 req-d0579035-190f-420d-9f24-bbed7a23aeb7 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-vif-plugged-528921b8-dc12-49ae-844c-26313949e09e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-921bc6ab-c08e-4e39-b364-2884d45aef67 req-d0579035-190f-420d-9f24-bbed7a23aeb7 service nova] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-921bc6ab-c08e-4e39-b364-2884d45aef67 req-d0579035-190f-420d-9f24-bbed7a23aeb7 service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-921bc6ab-c08e-4e39-b364-2884d45aef67 req-d0579035-190f-420d-9f24-bbed7a23aeb7 service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG nova.compute.manager [req-921bc6ab-c08e-4e39-b364-2884d45aef67 req-d0579035-190f-420d-9f24-bbed7a23aeb7 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] No waiting events found dispatching network-vif-plugged-528921b8-dc12-49ae-844c-26313949e09e {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:56:37 user nova-compute[75113]: WARNING nova.compute.manager [req-921bc6ab-c08e-4e39-b364-2884d45aef67 req-d0579035-190f-420d-9f24-bbed7a23aeb7 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received unexpected event network-vif-plugged-528921b8-dc12-49ae-844c-26313949e09e for instance with vm_state active and task_state None.
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "af957c0b-a655-4b55-974a-70256a760d3c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "af957c0b-a655-4b55-974a-70256a760d3c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG nova.objects.instance [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lazy-loading 'flavor' on Instance uuid af957c0b-a655-4b55-974a-70256a760d3c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "af957c0b-a655-4b55-974a-70256a760d3c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "f1769d95-897b-4e83-89ba-c486aa086dc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:38 user nova-compute[75113]: INFO nova.compute.manager [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Attaching volume 0876d835-1ab0-4103-9353-6361c87078cc to /dev/vdb
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.utils [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed35f84-5f56-482f-8dc3-f27828c6f5a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2959a4f5-16fb-40f5-b367-e95e57bc80ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe074f2-a377-4caf-b1b4-63217bdaf207]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7beee2-718a-47da-a815-31d901c72cbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.utils [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d854d63-a037-4c4b-954c-47ccb8b50346]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:56:38 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2107bf0-2d81-4783-9648-1877b8f48c7f]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.utils [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Updating existing volume attachment record: adbd7812-f200-4588-a0e1-0b659928b0b0 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e30026-1e66-4b39-8496-3b6e8e1b326f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbfbbd7-6fd2-4440-b68b-ac5cd04bd546]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2240025b-a3ed-4a6b-8ed8-f32402d01d41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:56:38 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5e38ce-1128-4c8e-9922-6d19919d2e7e]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.utils [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Updating existing volume attachment record: 792c9493-2653-4de2-8bfd-8fa6463e31d5 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23539306563346231', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539306563346231', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lazy-loading 'flavor' on Instance uuid ea7b1250-2387-491b-ac27-e1d3d27a13d2 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:56:38 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:56:38 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 16:56:38 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:56:38 user nova-compute[75113]:   <serial>80a2de16-30c8-4666-ac97-9406d443d446</serial>
Oct 26 16:56:38 user nova-compute[75113]: </disk>
Oct 26 16:56:38 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "af957c0b-a655-4b55-974a-70256a760d3c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "af957c0b-a655-4b55-974a-70256a760d3c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:38 user nova-compute[75113]: INFO nova.compute.manager [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Attaching volume c47097b2-9194-4fb6-9752-988cf51bcd25 to /dev/sdc
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.utils [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fd94b6-7189-4a8e-b70f-704561301dbb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59502f0-43b5-4277-913d-8b73b630f46d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8ac91a-6ca5-4dd2-b728-6bfafae48502]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea3f61a-531f-4105-acf4-4b4375d6f249]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:56:38 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:56:38 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a1ede6-d22d-4aee-bb12-fec9aef336b8]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG os_brick.utils [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:56:38 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Updating existing volume attachment record: 7d323d3e-3a9c-4b5c-85b5-ec5235120d4d {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:56:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:56:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:56:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] No VIF found with MAC fa:16:3e:1f:74:4a, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:56:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:56:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQrLwfmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:56:47 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:56:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:56:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:56:47 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:56:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:56:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:56:47 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:56:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b011a995-2d70-43e5-bcf6-903d79aac103]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:56:48 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de9cd4f-5aa1-45ef-98ce-df9bf46ec57a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08] added
Oct 26 16:56:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26f1333-b334-4edd-a5e9-dced5fec3e8b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ccdd46-698b-48ed-8181-2629e21a610f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQrLwfmA {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQrLwfmA" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9327dab1-9190-44c7-b136-e7a10e72b3e1]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vQrLwfmA'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d371751-5d46-4036-9785-0e732e7a4d22]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[078e06b8-54ac-4681-8de6-a7a1c2d28fe9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)
Oct 26 16:56:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)
Oct 26 16:56:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[be325cfb-aa6c-4b08-a48b-1f24430b185f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08, portal: 172.16.0.220,3260]
Oct 26 16:56:48 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08, portal: 172.16.0.220,3260] successful.
Oct 26 16:56:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e902693-d89a-49a5-9c5c-faaedfab00a1]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cdd5a2-4e8d-4616-baa5-1f39489e563b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)
Oct 26 16:56:48 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:56:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)
Oct 26 16:56:48 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:56:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[014a4683-330e-4878-a328-bfd0d5e1dd39]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:56:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQrLwfmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:56:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:56:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26330313731353637', 'path': '/dev/sdc'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:56:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330313731353637', 'path': '/dev/sdc'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:56:49 user nova-compute[75113]: DEBUG nova.objects.instance [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lazy-loading 'flavor' on Instance uuid fbf1e605-91c5-4188-9081-f9762ad92a9f {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:56:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:56:49 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:56:49 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 16:56:49 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:56:49 user nova-compute[75113]:   <serial>92367020-5467-406a-bff3-0089938acf08</serial>
Oct 26 16:56:49 user nova-compute[75113]: </disk>
Oct 26 16:56:49 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:56:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:56:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:56:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] No VIF found with MAC fa:16:3e:dc:3d:4b, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:56:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:54 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:56:54 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:56:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:56:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:56:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:56:54 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:56:55 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updating instance_info_cache with network_info: [{"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:56:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:56:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:56:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:56:57 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:56:57 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:56:58 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:56:58 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:56:58 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:56:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:56:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:56:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:56:58 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:56:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIubCUwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:56:59 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:56:59 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:56:59 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d24afb4-7524-4383-a8df-04cccfe2a13e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:56:59 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a574efdd-17f3-4ddc-a1b9-b45501873b7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f] added
Oct 26 16:56:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee42448c-dbd3-4ea7-b405-7a2171c44647]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a47f9d-a0c5-42f9-ac1f-5cde052b35c9]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIubCUwc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIubCUwc" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[45939cc1-f414-469a-a358-ff4e110218c4]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yIubCUwc'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5e856d-9f61-4e78-bb8f-46d3a07b5d9b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa97eb4-7491-4545-b5a7-d9bd5ac50b4d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)
Oct 26 16:56:59 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:56:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)
Oct 26 16:56:59 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:56:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[287390dc-3688-4d62-9941-e3e23929af26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f, portal: 172.16.0.220,3260]
Oct 26 16:56:59 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f, portal: 172.16.0.220,3260] successful.
Oct 26 16:56:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff31fd41-5a2a-466f-bcc0-208626367065]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca3ec22-521e-4e87-be48-4d08da6ff32a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)
Oct 26 16:56:59 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:56:59 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:56:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)
Oct 26 16:56:59 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:56:59 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:56:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6fc479-0582-4521-99ab-20e00fa0bf91]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:56:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIubCUwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23132663039313965', 'path': '/dev/sdd'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132663039313965', 'path': '/dev/sdd'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG nova.objects.instance [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lazy-loading 'flavor' on Instance uuid 9064edf2-de11-4223-baed-d346bfe34fcc {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:57:00 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:00 user nova-compute[75113]:   <source dev="/dev/sdd"/>
Oct 26 16:57:00 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:57:00 user nova-compute[75113]:   <serial>39c02300-9bdc-4407-af6b-163ff3803a7f</serial>
Oct 26 16:57:00 user nova-compute[75113]: </disk>
Oct 26 16:57:00 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:57:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] No BDM found with device name hda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:57:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] No VIF found with MAC fa:16:3e:84:a4:ac, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:57:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:57:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:02 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:57:02 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:57:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7537MB free_disk=25.42810821533203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ea7b1250-2387-491b-ac27-e1d3d27a13d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 645deae0-4c03-41d0-aa3b-daa79ed25425 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 69ed2396-a603-4c84-a66b-7b474523b68e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance f1769d95-897b-4e83-89ba-c486aa086dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance af957c0b-a655-4b55-974a-70256a760d3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fbf1e605-91c5-4188-9081-f9762ad92a9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e632e8ad-6d44-4a57-a04b-342bdf513260 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9064edf2-de11-4223-baed-d346bfe34fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance a8368686-8c4d-4373-a3a5-4498e2086e0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 8d18f293-ebac-4392-9405-869a7e23f3e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:57:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8264913-311b-4827-b24c-ef7ead741edd tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 59.880s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c3a41517-6542-486d-811a-84eff6579d1d tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.122s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG os_brick.utils [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d380e20-1f52-4046-bfd0-4cfe8eb667ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef51405-6bf6-428a-b3a0-1b02ab99d507]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd9fb45-a3f4-4f72-88e2-8758134d42c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48d422a-a9d0-4f3a-a290-66f2a163a5bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:57:03 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60e4afc-5d0e-4790-b08f-fb560546604b]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG os_brick.utils [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Updating existing volume attachment record: 0698f806-3604-41fa-a5ed-140a9bf8d371 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-30c05909-7d6a-45c4-a7bf-9effc3ef4bb8 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "9064edf2-de11-4223-baed-d346bfe34fcc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.691s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:03 user nova-compute[75113]: INFO nova.virt.block_device [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Booting with volume 744f5bef-bbc8-48f4-9376-4ed4731670d7 at /dev/vdc
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:03 user nova-compute[75113]: INFO nova.compute.manager [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Terminating instance
Oct 26 16:57:03 user nova-compute[75113]: DEBUG nova.compute.manager [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-88b62b28-fddf-418e-bb05-30d4b42fcc9c req-2df26645-3142-46f3-869a-04388434f758 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Received event network-vif-unplugged-c66a2219-e937-4d6b-8c1c-275d9f4ee094 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-88b62b28-fddf-418e-bb05-30d4b42fcc9c req-2df26645-3142-46f3-869a-04388434f758 service nova] Acquiring lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-88b62b28-fddf-418e-bb05-30d4b42fcc9c req-2df26645-3142-46f3-869a-04388434f758 service nova] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-88b62b28-fddf-418e-bb05-30d4b42fcc9c req-2df26645-3142-46f3-869a-04388434f758 service nova] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-88b62b28-fddf-418e-bb05-30d4b42fcc9c req-2df26645-3142-46f3-869a-04388434f758 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] No waiting events found dispatching network-vif-unplugged-c66a2219-e937-4d6b-8c1c-275d9f4ee094 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-88b62b28-fddf-418e-bb05-30d4b42fcc9c req-2df26645-3142-46f3-869a-04388434f758 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Received event network-vif-unplugged-c66a2219-e937-4d6b-8c1c-275d9f4ee094 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:57:04 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Instance destroyed successfully.
Oct 26 16:57:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lazy-loading 'resources' on Instance uuid ea7b1250-2387-491b-ac27-e1d3d27a13d2 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1783769704',display_name='tempest-DeleteServersTestJSON-server-1783769704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1783769704',id=1,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548b8c64bc7f4d19b3a84d83dbebc813',ramdisk_id='',reservation_id='r-ykqs7d4h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1739635469',owner_user_name='tempest-DeleteServersTestJSON-1739635469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:54:21Z,user_data=None,user_id='2a2fb42c068a49d88c94b67044216201',uuid=ea7b1250-2387-491b-ac27-e1d3d27a13d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "address": "fa:16:3e:1f:74:4a", "network": {"id": "70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-479778024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b8c64bc7f4d19b3a84d83dbebc813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a2219-e9", "ovs_interfaceid": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Converting VIF {"id": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "address": "fa:16:3e:1f:74:4a", "network": {"id": "70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-479778024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b8c64bc7f4d19b3a84d83dbebc813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a2219-e9", "ovs_interfaceid": "c66a2219-e937-4d6b-8c1c-275d9f4ee094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:74:4a,bridge_name='br-int',has_traffic_filtering=True,id=c66a2219-e937-4d6b-8c1c-275d9f4ee094,network=Network(70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a2219-e9') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_vif [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:74:4a,bridge_name='br-int',has_traffic_filtering=True,id=c66a2219-e937-4d6b-8c1c-275d9f4ee094,network=Network(70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a2219-e9') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc66a2219-e9, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac1ec1f2-6eb8-4e0a-9f0a-7da3beff7ffe) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:04 user nova-compute[75113]: INFO os_vif [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:74:4a,bridge_name='br-int',has_traffic_filtering=True,id=c66a2219-e937-4d6b-8c1c-275d9f4ee094,network=Network(70c50a7c-c344-4d5e-b4fb-0f5bd7342fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a2219-e9')
Oct 26 16:57:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLMIiScs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:04 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3f7002-4921-4224-a6a8-9ef4f7bf46f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:57:04 user nova-compute[75113]: No targets found.
Oct 26 16:57:04 user nova-compute[75113]: iSNS:
Oct 26 16:57:04 user nova-compute[75113]: No targets found.
Oct 26 16:57:04 user nova-compute[75113]: STATIC:
Oct 26 16:57:04 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08
Oct 26 16:57:04 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:04 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:04 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f
Oct 26 16:57:04 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:04 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:04 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446
Oct 26 16:57:04 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:04 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:04 user nova-compute[75113]: FIRMWARE:
Oct 26 16:57:04 user nova-compute[75113]: No targets found.
Oct 26 16:57:04 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:57:04 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:57:04 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa51a31-42c1-4b0c-b2e9-ad0f414dab88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[078e3045-eedd-47b8-8e83-ed1ae0daffe6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)
Oct 26 16:57:04 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:04 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:04 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 (non-flash)
Oct 26 16:57:04 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:04 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:04 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f492c1b1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[498cd6ff-7ce6-4f15-bbe8-ef809d294f83]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2487844e-641b-4b59-bceb-94cafd430ac1]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fd45f4-76c3-4d41-a643-743051949d29]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b953d0-9509-45ac-9059-d1d1db80ebaa]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[82df06ed-5b61-4c5f-b46b-88cf3bd8e08a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b976241-4b7f-4665-a5cf-18eee82f9a69]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446, portal: 172.16.0.220,3260]
Oct 26 16:57:05 user nova-compute[75113]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446, portal: 172.16.0.220,3260] successful.
Oct 26 16:57:05 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a2de16-30c8-4666-ac97-9406d443d446 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f98859-e001-4a74-83d9-89229d323d2a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] <== disconnect_volume: return (317ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:57:05 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Deleting instance files /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2_del
Oct 26 16:57:05 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Deletion of /opt/stack/data/nova/instances/ea7b1250-2387-491b-ac27-e1d3d27a13d2_del complete
Oct 26 16:57:05 user nova-compute[75113]: INFO nova.compute.manager [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 26 16:57:05 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:57:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:06 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:57:06 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Took 1.08 seconds to deallocate network for instance.
Oct 26 16:57:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-4effc94c-0cb8-4eeb-8c97-e900e72d442e req-53fd7721-2cf7-48ee-b616-b695b4117f55 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Received event network-vif-plugged-c66a2219-e937-4d6b-8c1c-275d9f4ee094 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4effc94c-0cb8-4eeb-8c97-e900e72d442e req-53fd7721-2cf7-48ee-b616-b695b4117f55 service nova] Acquiring lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4effc94c-0cb8-4eeb-8c97-e900e72d442e req-53fd7721-2cf7-48ee-b616-b695b4117f55 service nova] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4effc94c-0cb8-4eeb-8c97-e900e72d442e req-53fd7721-2cf7-48ee-b616-b695b4117f55 service nova] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-4effc94c-0cb8-4eeb-8c97-e900e72d442e req-53fd7721-2cf7-48ee-b616-b695b4117f55 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] No waiting events found dispatching network-vif-plugged-c66a2219-e937-4d6b-8c1c-275d9f4ee094 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:06 user nova-compute[75113]: WARNING nova.compute.manager [req-4effc94c-0cb8-4eeb-8c97-e900e72d442e req-53fd7721-2cf7-48ee-b616-b695b4117f55 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Received unexpected event network-vif-plugged-c66a2219-e937-4d6b-8c1c-275d9f4ee094 for instance with vm_state active and task_state deleting.
Oct 26 16:57:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-4effc94c-0cb8-4eeb-8c97-e900e72d442e req-53fd7721-2cf7-48ee-b616-b695b4117f55 service nova] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Received event network-vif-deleted-c66a2219-e937-4d6b-8c1c-275d9f4ee094 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaZkRNGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:08 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:08 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:08 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c39200f-6cb3-4c25-8f6f-dbce59005f02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:57:08 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c103845a-99cd-418a-bb21-77b558338a5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8] added
Oct 26 16:57:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2269cfcb-f0f9-41bb-8a24-5b936730bdd7]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[839bc005-e647-4a15-932f-6e78ccf85029]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DaZkRNGH {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DaZkRNGH" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[998e14ff-101f-4a75-a0e6-a670bed1144b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DaZkRNGH'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6be0d55-7881-4ec7-92dd-6ecf941954b5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c598ed85-a34d-494c-a7d9-d4f18f780b1a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:08 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:08 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[599e12d9-fc8e-4165-bc46-0e5bfe3dbd5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8, portal: 172.16.0.220,3260]
Oct 26 16:57:08 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8, portal: 172.16.0.220,3260] successful.
Oct 26 16:57:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ce9a67-2050-4e77-84ae-47fccdd0a6b1]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4e9c71-a938-4aeb-bb9e-4cc75d47ee5d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:08 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:08 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:08 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:08 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] HCTL ('33', '-', '-', 0) found on session 5 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ac29bb-f13e-4d7b-96a0-9faf2d7cd58d]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:57:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaZkRNGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:57:09 user nova-compute[75113]: INFO nova.compute.manager [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] [instance: ea7b1250-2387-491b-ac27-e1d3d27a13d2] Took 3.23 seconds to detach 1 volumes for instance.
Oct 26 16:57:09 user nova-compute[75113]: DEBUG os_brick.utils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26131346362393136', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131346362393136', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[828af11d-c461-40d9-993e-e3163c112003]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG nova.objects.instance [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lazy-loading 'flavor' on Instance uuid e632e8ad-6d44-4a57-a04b-342bdf513260 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f06bcb-654d-428d-901c-d5b568a1baf0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5b0529-3f1a-4020-a633-a6dce06bd1b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b22e9c-f9da-42a6-a0e9-12226a8fc8a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:57:09 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:57:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] attach device xml: <disk type="block" device="disk">
Oct 26 16:57:09 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:09 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 16:57:09 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:57:09 user nova-compute[75113]:   <serial>389de90c-9f08-4f96-aa61-6e14d723a2b8</serial>
Oct 26 16:57:09 user nova-compute[75113]: </disk>
Oct 26 16:57:09 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aec8252-b8a1-405e-a6c1-c5a5d463dfc4]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG os_brick.utils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating existing volume attachment record: 1bf801d6-852b-4d51-aad2-e8c28128be6b {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:09 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:57:10 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:57:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:10 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Deleted allocations for instance ea7b1250-2387-491b-ac27-e1d3d27a13d2
Oct 26 16:57:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:57:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:57:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] No VIF found with MAC fa:16:3e:8a:01:23, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:57:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1bd943a-9be3-40a1-8bed-271f8a46355d tempest-DeleteServersTestJSON-1739635469 tempest-DeleteServersTestJSON-1739635469-project-member] Lock "ea7b1250-2387-491b-ac27-e1d3d27a13d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.363s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlBDdSbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:21 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:21 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:21 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d1b7b2-3abb-4a30-a903-3b17d5c272ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:57:21 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[865adc9d-5f1f-4cf7-9480-ee9f2b9cd6f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc] added
Oct 26 16:57:21 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f688565-d7f6-4a60-96f7-8dddbbd68cee]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eab92d-a288-49eb-9bce-5d71c951a498]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GlBDdSbi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GlBDdSbi" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5e966d-1f8b-44df-a526-8f6165b9e1c5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GlBDdSbi'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6dc5c3-992f-48f6-8294-b12ea078e7da]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8329731e-365d-4478-b374-b04eb6731a54 tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.763s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9eeeed-cc09-4b17-8e12-37ea283a36bd]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:21 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:21 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:21 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:21 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:21 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:21 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba560981-89a9-45e4-983e-8a2d7e55e331]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc, portal: 172.16.0.220,3260]
Oct 26 16:57:21 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc, portal: 172.16.0.220,3260] successful.
Oct 26 16:57:21 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[606f9208-7471-4a8a-9db2-ce357ec199cf]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[888755ba-95d2-4c9a-9c49-862d50199892]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:21 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:21 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:21 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:21 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:21 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:21 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:21 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:21 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fc654a-a708-4ffa-b405-a9d1c6142123]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:57:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlBDdSbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "9064edf2-de11-4223-baed-d346bfe34fcc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:22 user nova-compute[75113]: INFO nova.compute.manager [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Detaching volume 39c02300-9bdc-4407-af6b-163ff3803a7f
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] Acquiring lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG os_brick.utils [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:22 user nova-compute[75113]: INFO nova.virt.block_device [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Attempting to driver detach volume 39c02300-9bdc-4407-af6b-163ff3803a7f from mountpoint /dev/vdb
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f03af3-b176-4af8-83d5-f3734eb8d914]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Attempting to detach device vdb from instance 9064edf2-de11-4223-baed-d346bfe34fcc from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:57:22 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:22 user nova-compute[75113]:   <source dev="/dev/sdd"/>
Oct 26 16:57:22 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:57:22 user nova-compute[75113]:   <serial>39c02300-9bdc-4407-af6b-163ff3803a7f</serial>
Oct 26 16:57:22 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 16:57:22 user nova-compute[75113]: </disk>
Oct 26 16:57:22 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:57:22 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Successfully detached device vdb from instance 9064edf2-de11-4223-baed-d346bfe34fcc from the persistent domain config.
Oct 26 16:57:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9064edf2-de11-4223-baed-d346bfe34fcc from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:57:22 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:22 user nova-compute[75113]:   <source dev="/dev/sdd"/>
Oct 26 16:57:22 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:57:22 user nova-compute[75113]:   <serial>39c02300-9bdc-4407-af6b-163ff3803a7f</serial>
Oct 26 16:57:22 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 16:57:22 user nova-compute[75113]: </disk>
Oct 26 16:57:22 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6919c5ea-f05a-4f5a-a5d9-08be0b44a3b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "cafa9881-242a-4275-8125-80f415d56ee8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "cafa9881-242a-4275-8125-80f415d56ee8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9064edf2-de11-4223-baed-d346bfe34fcc {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9a735a3c-7392-4f11-933c-e9a74e2b6430 tempest-VolumesAssistedSnapshotsTest-789343991 tempest-VolumesAssistedSnapshotsTest-789343991-project] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] volume_snapshot_create: create_info: {'snapshot_id': '9991c331-aeaa-4987-aa8a-e892b440b89c', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75113) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9d62ed87-13e9-42cc-a883-9d60a1103f23 tempest-VolumesAssistedSnapshotsTest-789343991 tempest-VolumesAssistedSnapshotsTest-789343991-project] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] volume_snapshot_delete: delete_info: {'volume_id': '389de90c-9f08-4f96-aa61-6e14d723a2b8'} {{(pid=75113) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [None req-9d62ed87-13e9-42cc-a883-9d60a1103f23 tempest-VolumesAssistedSnapshotsTest-789343991 tempest-VolumesAssistedSnapshotsTest-789343991-project] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Traceback (most recent call last):
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     if delete_info['type'] != 'qcow2':
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] KeyError: 'type'
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] 
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9a735a3c-7392-4f11-933c-e9a74e2b6430 tempest-VolumesAssistedSnapshotsTest-789343991 tempest-VolumesAssistedSnapshotsTest-789343991-project] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] snap xml: <domainsnapshot>
Oct 26 16:57:22 user nova-compute[75113]:   <disks>
Oct 26 16:57:22 user nova-compute[75113]:     <disk name="/dev/sdb" snapshot="external" type="file">
Oct 26 16:57:22 user nova-compute[75113]:       <source file="/dev/new_file"/>
Oct 26 16:57:22 user nova-compute[75113]:     </disk>
Oct 26 16:57:22 user nova-compute[75113]:     <disk name="vda" snapshot="no"/>
Oct 26 16:57:22 user nova-compute[75113]:   </disks>
Oct 26 16:57:22 user nova-compute[75113]: </domainsnapshot>
Oct 26 16:57:22 user nova-compute[75113]:  {{(pid=75113) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG nova.objects.instance [None req-9a735a3c-7392-4f11-933c-e9a74e2b6430 tempest-VolumesAssistedSnapshotsTest-789343991 tempest-VolumesAssistedSnapshotsTest-789343991-project] Lazy-loading 'system_metadata' on Instance uuid e632e8ad-6d44-4a57-a04b-342bdf513260 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9537d54-6ecd-4a09-a0ea-103cbe8a15e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG nova.compute.manager [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b619f06f-ef83-48b3-a840-20a1ce039b0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [None req-9d62ed87-13e9-42cc-a883-9d60a1103f23 tempest-VolumesAssistedSnapshotsTest-789343991 tempest-VolumesAssistedSnapshotsTest-789343991-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver 
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver 
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-1629e05c-00e9-473e-9ee6-31f251d3d9ad)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver 
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver 
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver 
Oct 26 16:57:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26236646532393133', 'path': '/dev/sde'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236646532393133', 'path': '/dev/sde'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Acquiring lock "e632e8ad-6d44-4a57-a04b-342bdf513260" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:22 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-9a735a3c-7392-4f11-933c-e9a74e2b6430 tempest-VolumesAssistedSnapshotsTest-789343991 tempest-VolumesAssistedSnapshotsTest-789343991-project] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:57:22 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e643a487-a217-4b19-889a-b422a91eb4c0]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG os_brick.utils [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] <== get_connector_properties: return (679ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:22 user nova-compute[75113]: INFO nova.compute.manager [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Detaching volume 389de90c-9f08-4f96-aa61-6e14d723a2b8
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [None req-9a735a3c-7392-4f11-933c-e9a74e2b6430 tempest-VolumesAssistedSnapshotsTest-789343991 tempest-VolumesAssistedSnapshotsTest-789343991-project] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Traceback (most recent call last):
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     rv = execute(f, *args, **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     six.reraise(c, e, tb)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     raise value
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     rv = meth(*args, **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] 
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [None req-9a735a3c-7392-4f11-933c-e9a74e2b6430 tempest-VolumesAssistedSnapshotsTest-789343991 tempest-VolumesAssistedSnapshotsTest-789343991-project] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Traceback (most recent call last):
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     self._volume_snapshot_create(context, instance, guest,
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     rv = execute(f, *args, **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     six.reraise(c, e, tb)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     raise value
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     rv = meth(*args, **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 16:57:22 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] 
Oct 26 16:57:22 user nova-compute[75113]: DEBUG nova.objects.instance [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lazy-loading 'flavor' on Instance uuid f1769d95-897b-4e83-89ba-c486aa086dc1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server [None req-9d62ed87-13e9-42cc-a883-9d60a1103f23 tempest-VolumesAssistedSnapshotsTest-789343991 tempest-VolumesAssistedSnapshotsTest-789343991-project] Exception during message handling: KeyError: 'type'
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 26 16:57:22 user nova-compute[75113]: ERROR oslo_messaging.rpc.server 
Oct 26 16:57:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:57:22 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:22 user nova-compute[75113]:   <source dev="/dev/sde"/>
Oct 26 16:57:22 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:57:22 user nova-compute[75113]:   <serial>0876d835-1ab0-4103-9353-6361c87078cc</serial>
Oct 26 16:57:22 user nova-compute[75113]: </disk>
Oct 26 16:57:22 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:57:23 user nova-compute[75113]: INFO nova.compute.claims [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Claim successful on node user
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver [None req-9a735a3c-7392-4f11-933c-e9a74e2b6430 tempest-VolumesAssistedSnapshotsTest-789343991 tempest-VolumesAssistedSnapshotsTest-789343991-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 9991c331-aeaa-4987-aa8a-e892b440b89c could not be found.
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     raise value
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver 
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver 
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 9991c331-aeaa-4987-aa8a-e892b440b89c could not be found. (HTTP 404) (Request-ID: req-1aa4920f-a018-405a-bbb6-dfc77ca47951)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver 
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver 
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 9991c331-aeaa-4987-aa8a-e892b440b89c could not be found.
Oct 26 16:57:23 user nova-compute[75113]: ERROR nova.virt.libvirt.driver 
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server [None req-9a735a3c-7392-4f11-933c-e9a74e2b6430 tempest-VolumesAssistedSnapshotsTest-789343991 tempest-VolumesAssistedSnapshotsTest-789343991-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise value
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 16:57:23 user nova-compute[75113]: ERROR oslo_messaging.rpc.server 
Oct 26 16:57:23 user nova-compute[75113]: INFO nova.compute.manager [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Swapping volume 92367020-5467-406a-bff3-0089938acf08 for 7d3ccee2-e704-4123-9238-ac5751294209
Oct 26 16:57:23 user nova-compute[75113]: INFO nova.virt.block_device [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Attempting to driver detach volume 389de90c-9f08-4f96-aa61-6e14d723a2b8 from mountpoint /dev/vdb
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Attempting to detach device vdb from instance e632e8ad-6d44-4a57-a04b-342bdf513260 from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] detach device xml: <disk type="block" device="disk">
Oct 26 16:57:23 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:23 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 16:57:23 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:57:23 user nova-compute[75113]:   <serial>389de90c-9f08-4f96-aa61-6e14d723a2b8</serial>
Oct 26 16:57:23 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:57:23 user nova-compute[75113]: </disk>
Oct 26 16:57:23 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:57:23 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Successfully detached device vdb from instance e632e8ad-6d44-4a57-a04b-342bdf513260 from the persistent domain config.
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e632e8ad-6d44-4a57-a04b-342bdf513260 from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] detach device xml: <disk type="block" device="disk">
Oct 26 16:57:23 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:23 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 16:57:23 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:57:23 user nova-compute[75113]:   <serial>389de90c-9f08-4f96-aa61-6e14d723a2b8</serial>
Oct 26 16:57:23 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:57:23 user nova-compute[75113]: </disk>
Oct 26 16:57:23 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] No VIF found with MAC fa:16:3e:54:a8:27, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.compute.manager [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.compute.manager [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.network.neutron [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:57:23 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e632e8ad-6d44-4a57-a04b-342bdf513260 {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.compute.manager [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.policy [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ce0a834257344abb3dd5718ece6e46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f527bb82a1c45f08faded8f87750026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.compute.manager [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:57:23 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Creating image(s)
Oct 26 16:57:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "/opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "/opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "/opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.210s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG nova.network.neutron [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Successfully created port: c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk 1073741824" returned: 0 in 0.053s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Cannot resize image /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Ensure instance console log exists: /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG nova.network.neutron [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Successfully updated port: c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "refresh_cache-cafa9881-242a-4275-8125-80f415d56ee8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquired lock "refresh_cache-cafa9881-242a-4275-8125-80f415d56ee8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG nova.network.neutron [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-da70ae1f-2f57-407b-8899-e27409852a06 req-8e660637-8e0c-4189-834f-ada3cdac2650 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Received event network-changed-c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-da70ae1f-2f57-407b-8899-e27409852a06 req-8e660637-8e0c-4189-834f-ada3cdac2650 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Refreshing instance network info cache due to event network-changed-c7b6c1aa-2d23-4be9-add7-b54f42557d05. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:57:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-da70ae1f-2f57-407b-8899-e27409852a06 req-8e660637-8e0c-4189-834f-ada3cdac2650 service nova] Acquiring lock "refresh_cache-cafa9881-242a-4275-8125-80f415d56ee8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.network.neutron [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.network.neutron [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Updating instance_info_cache with network_info: [{"id": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "address": "fa:16:3e:fd:e6:f5", "network": {"id": "2fb896f7-d8a7-49a5-a9ee-90da1afff111", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-610632337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f527bb82a1c45f08faded8f87750026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b6c1aa-2d", "ovs_interfaceid": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjogtuEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:25 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:25 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:25 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Releasing lock "refresh_cache-cafa9881-242a-4275-8125-80f415d56ee8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Instance network_info: |[{"id": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "address": "fa:16:3e:fd:e6:f5", "network": {"id": "2fb896f7-d8a7-49a5-a9ee-90da1afff111", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-610632337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f527bb82a1c45f08faded8f87750026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b6c1aa-2d", "ovs_interfaceid": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-da70ae1f-2f57-407b-8899-e27409852a06 req-8e660637-8e0c-4189-834f-ada3cdac2650 service nova] Acquired lock "refresh_cache-cafa9881-242a-4275-8125-80f415d56ee8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.network.neutron [req-da70ae1f-2f57-407b-8899-e27409852a06 req-8e660637-8e0c-4189-834f-ada3cdac2650 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Refreshing network info cache for port c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Start _get_guest_xml network_info=[{"id": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "address": "fa:16:3e:fd:e6:f5", "network": {"id": "2fb896f7-d8a7-49a5-a9ee-90da1afff111", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-610632337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f527bb82a1c45f08faded8f87750026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b6c1aa-2d", "ovs_interfaceid": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:57:25 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:57:25 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12c35c1-ed60-4e8d-95ab-a7dafcd31349]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:57:25 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2076590787',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2076590787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2076590',id=11,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjTM4xnfW1L39yh4ENtMY8vNabyrzDFVSkNLIg0LSeYrJFDWNZz77x+arwkJf6QSghM194dqaazcw1zjlSPtB/0Ddd0RrwBI4TX7FoGwFF249gJy+QThjE4IR0sbG+FcQ==',key_name='tempest-keypair-1930011595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f527bb82a1c45f08faded8f87750026',ramdisk_id='',reservation_id='r-libp0vzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2136726404',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:57:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce0a834257344abb3dd5718ece6e46e',uuid=cafa9881-242a-4275-8125-80f415d56ee8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "address": "fa:16:3e:fd:e6:f5", "network": {"id": "2fb896f7-d8a7-49a5-a9ee-90da1afff111", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-610632337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f527bb82a1c45f08faded8f87750026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b6c1aa-2d", "ovs_interfaceid": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Converting VIF {"id": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "address": "fa:16:3e:fd:e6:f5", "network": {"id": "2fb896f7-d8a7-49a5-a9ee-90da1afff111", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-610632337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f527bb82a1c45f08faded8f87750026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b6c1aa-2d", "ovs_interfaceid": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e6:f5,bridge_name='br-int',has_traffic_filtering=True,id=c7b6c1aa-2d23-4be9-add7-b54f42557d05,network=Network(2fb896f7-d8a7-49a5-a9ee-90da1afff111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b6c1aa-2d') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.objects.instance [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lazy-loading 'pci_devices' on Instance uuid cafa9881-242a-4275-8125-80f415d56ee8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a51af5-9268-4e6f-872c-4b8b2ecc9373]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25] added
Oct 26 16:57:25 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:57:25 user nova-compute[75113]:   <uuid>cafa9881-242a-4275-8125-80f415d56ee8</uuid>
Oct 26 16:57:25 user nova-compute[75113]:   <name>instance-0000000b</name>
Oct 26 16:57:25 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:57:25 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:57:25 user nova-compute[75113]:   <metadata>
Oct 26 16:57:25 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:57:25 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:57:25 user nova-compute[75113]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2076590787</nova:name>
Oct 26 16:57:25 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:57:25</nova:creationTime>
Oct 26 16:57:25 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:57:25 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:57:25 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:57:25 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:57:25 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:57:25 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:57:25 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:57:25 user nova-compute[75113]:       <nova:owner>
Oct 26 16:57:25 user nova-compute[75113]:         <nova:user uuid="8ce0a834257344abb3dd5718ece6e46e">tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member</nova:user>
Oct 26 16:57:25 user nova-compute[75113]:         <nova:project uuid="6f527bb82a1c45f08faded8f87750026">tempest-TestServerVolumeAttachScenarioOldVersion-2136726404</nova:project>
Oct 26 16:57:25 user nova-compute[75113]:       </nova:owner>
Oct 26 16:57:25 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:57:25 user nova-compute[75113]:       <nova:ports>
Oct 26 16:57:25 user nova-compute[75113]:         <nova:port uuid="c7b6c1aa-2d23-4be9-add7-b54f42557d05">
Oct 26 16:57:25 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 16:57:25 user nova-compute[75113]:         </nova:port>
Oct 26 16:57:25 user nova-compute[75113]:       </nova:ports>
Oct 26 16:57:25 user nova-compute[75113]:     </nova:instance>
Oct 26 16:57:25 user nova-compute[75113]:   </metadata>
Oct 26 16:57:25 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:57:25 user nova-compute[75113]:     <system>
Oct 26 16:57:25 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:57:25 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:57:25 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:57:25 user nova-compute[75113]:       <entry name="serial">cafa9881-242a-4275-8125-80f415d56ee8</entry>
Oct 26 16:57:25 user nova-compute[75113]:       <entry name="uuid">cafa9881-242a-4275-8125-80f415d56ee8</entry>
Oct 26 16:57:25 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:57:25 user nova-compute[75113]:     </system>
Oct 26 16:57:25 user nova-compute[75113]:   </sysinfo>
Oct 26 16:57:25 user nova-compute[75113]:   <os>
Oct 26 16:57:25 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:57:25 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:57:25 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:57:25 user nova-compute[75113]:   </os>
Oct 26 16:57:25 user nova-compute[75113]:   <features>
Oct 26 16:57:25 user nova-compute[75113]:     <acpi/>
Oct 26 16:57:25 user nova-compute[75113]:     <apic/>
Oct 26 16:57:25 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:57:25 user nova-compute[75113]:   </features>
Oct 26 16:57:25 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:57:25 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:57:25 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:57:25 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:57:25 user nova-compute[75113]:   </clock>
Oct 26 16:57:25 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:57:25 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:57:25 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:57:25 user nova-compute[75113]:   </cpu>
Oct 26 16:57:25 user nova-compute[75113]:   <devices>
Oct 26 16:57:25 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:57:25 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:57:25 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk"/>
Oct 26 16:57:25 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:57:25 user nova-compute[75113]:     </disk>
Oct 26 16:57:25 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:57:25 user nova-compute[75113]:       <mac address="fa:16:3e:fd:e6:f5"/>
Oct 26 16:57:25 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:57:25 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:57:25 user nova-compute[75113]:       <target dev="tapc7b6c1aa-2d"/>
Oct 26 16:57:25 user nova-compute[75113]:     </interface>
Oct 26 16:57:25 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:57:25 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/console.log" append="off"/>
Oct 26 16:57:25 user nova-compute[75113]:     </serial>
Oct 26 16:57:25 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:57:25 user nova-compute[75113]:     <video>
Oct 26 16:57:25 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:57:25 user nova-compute[75113]:     </video>
Oct 26 16:57:25 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:57:25 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:57:25 user nova-compute[75113]:     </rng>
Oct 26 16:57:25 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:57:25 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:57:25 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:57:25 user nova-compute[75113]:     </memballoon>
Oct 26 16:57:25 user nova-compute[75113]:   </devices>
Oct 26 16:57:25 user nova-compute[75113]: </domain>
Oct 26 16:57:25 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2076590787',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2076590787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2076590',id=11,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjTM4xnfW1L39yh4ENtMY8vNabyrzDFVSkNLIg0LSeYrJFDWNZz77x+arwkJf6QSghM194dqaazcw1zjlSPtB/0Ddd0RrwBI4TX7FoGwFF249gJy+QThjE4IR0sbG+FcQ==',key_name='tempest-keypair-1930011595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f527bb82a1c45f08faded8f87750026',ramdisk_id='',reservation_id='r-libp0vzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2136726404',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:57:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce0a834257344abb3dd5718ece6e46e',uuid=cafa9881-242a-4275-8125-80f415d56ee8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "address": "fa:16:3e:fd:e6:f5", "network": {"id": "2fb896f7-d8a7-49a5-a9ee-90da1afff111", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-610632337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f527bb82a1c45f08faded8f87750026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b6c1aa-2d", "ovs_interfaceid": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Converting VIF {"id": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "address": "fa:16:3e:fd:e6:f5", "network": {"id": "2fb896f7-d8a7-49a5-a9ee-90da1afff111", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-610632337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f527bb82a1c45f08faded8f87750026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b6c1aa-2d", "ovs_interfaceid": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e6:f5,bridge_name='br-int',has_traffic_filtering=True,id=c7b6c1aa-2d23-4be9-add7-b54f42557d05,network=Network(2fb896f7-d8a7-49a5-a9ee-90da1afff111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b6c1aa-2d') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_vif [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e6:f5,bridge_name='br-int',has_traffic_filtering=True,id=c7b6c1aa-2d23-4be9-add7-b54f42557d05,network=Network(2fb896f7-d8a7-49a5-a9ee-90da1afff111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b6c1aa-2d') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f498bf-fe46-4985-83e2-e272429062a1]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd551f71-d477-5425-9890-70e9a0a7f2db', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7b6c1aa-2d, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7b6c1aa-2d, col_values=(('qos', UUID('d3d6d741-15a2-4b54-8f01-9cf71db506d3')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7b6c1aa-2d, col_values=(('external_ids', {'iface-id': 'c7b6c1aa-2d23-4be9-add7-b54f42557d05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:e6:f5', 'vm-uuid': 'cafa9881-242a-4275-8125-80f415d56ee8'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9cfaa3-4b02-4aa9-86e1-b5de56a689b8]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:25 user nova-compute[75113]: INFO os_vif [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e6:f5,bridge_name='br-int',has_traffic_filtering=True,id=c7b6c1aa-2d23-4be9-add7-b54f42557d05,network=Network(2fb896f7-d8a7-49a5-a9ee-90da1afff111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b6c1aa-2d')
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UjogtuEF {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UjogtuEF" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b2bfed-d745-43f0-baf8-5cfcd7a2cf74]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UjogtuEF'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e59755e5-6e12-448f-98e9-f472e62d05ab tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.393s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daf07a5-0638-4d05-831f-810985cff2eb]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] No VIF found with MAC fa:16:3e:fd:e6:f5, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4e3158-c937-435c-9c80-34f1af6c9607]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:25 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:25 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ef7924-b5f6-4e0d-b371-54263255eb52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25, portal: 172.16.0.220,3260]
Oct 26 16:57:25 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25, portal: 172.16.0.220,3260] successful.
Oct 26 16:57:25 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72f47d7-6602-4c2f-978f-f4666a86c818]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b6f02c-619d-4368-a0d3-3400bdbd5111]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:25 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:25 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:25 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4afa22-aded-45dd-87ee-47e1eb2387b3]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.network.neutron [req-da70ae1f-2f57-407b-8899-e27409852a06 req-8e660637-8e0c-4189-834f-ada3cdac2650 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Updated VIF entry in instance network info cache for port c7b6c1aa-2d23-4be9-add7-b54f42557d05. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG nova.network.neutron [req-da70ae1f-2f57-407b-8899-e27409852a06 req-8e660637-8e0c-4189-834f-ada3cdac2650 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Updating instance_info_cache with network_info: [{"id": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "address": "fa:16:3e:fd:e6:f5", "network": {"id": "2fb896f7-d8a7-49a5-a9ee-90da1afff111", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-610632337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f527bb82a1c45f08faded8f87750026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b6c1aa-2d", "ovs_interfaceid": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-da70ae1f-2f57-407b-8899-e27409852a06 req-8e660637-8e0c-4189-834f-ada3cdac2650 service nova] Releasing lock "refresh_cache-cafa9881-242a-4275-8125-80f415d56ee8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:57:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:57:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjogtuEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:57:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26136666261643536', 'path': '/dev/sdf'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136666261643536', 'path': '/dev/sdf'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:57:26 user nova-compute[75113]: DEBUG nova.objects.instance [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lazy-loading 'flavor' on Instance uuid af957c0b-a655-4b55-974a-70256a760d3c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:57:26 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:26 user nova-compute[75113]:   <source dev="/dev/sdf"/>
Oct 26 16:57:26 user nova-compute[75113]:   <target dev="sdc" bus="scsi"/>
Oct 26 16:57:26 user nova-compute[75113]:   <serial>c47097b2-9194-4fb6-9752-988cf51bcd25</serial>
Oct 26 16:57:26 user nova-compute[75113]:   <address type="drive" controller="0" unit="2"/>
Oct 26 16:57:26 user nova-compute[75113]: </disk>
Oct 26 16:57:26 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:57:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "f1769d95-897b-4e83-89ba-c486aa086dc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:27 user nova-compute[75113]: INFO nova.compute.manager [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Detaching volume 0876d835-1ab0-4103-9353-6361c87078cc
Oct 26 16:57:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-4b1519b1-5712-47c5-a7dd-16819f80c9be req-2695ce54-cb0e-4af3-a9c3-c72e1c27cf5a service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Received event network-vif-plugged-c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4b1519b1-5712-47c5-a7dd-16819f80c9be req-2695ce54-cb0e-4af3-a9c3-c72e1c27cf5a service nova] Acquiring lock "cafa9881-242a-4275-8125-80f415d56ee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4b1519b1-5712-47c5-a7dd-16819f80c9be req-2695ce54-cb0e-4af3-a9c3-c72e1c27cf5a service nova] Lock "cafa9881-242a-4275-8125-80f415d56ee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4b1519b1-5712-47c5-a7dd-16819f80c9be req-2695ce54-cb0e-4af3-a9c3-c72e1c27cf5a service nova] Lock "cafa9881-242a-4275-8125-80f415d56ee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-4b1519b1-5712-47c5-a7dd-16819f80c9be req-2695ce54-cb0e-4af3-a9c3-c72e1c27cf5a service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] No waiting events found dispatching network-vif-plugged-c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:27 user nova-compute[75113]: WARNING nova.compute.manager [req-4b1519b1-5712-47c5-a7dd-16819f80c9be req-2695ce54-cb0e-4af3-a9c3-c72e1c27cf5a service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Received unexpected event network-vif-plugged-c7b6c1aa-2d23-4be9-add7-b54f42557d05 for instance with vm_state building and task_state spawning.
Oct 26 16:57:27 user nova-compute[75113]: INFO nova.virt.block_device [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Attempting to driver detach volume 0876d835-1ab0-4103-9353-6361c87078cc from mountpoint /dev/vdb
Oct 26 16:57:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Attempting to detach device vdb from instance f1769d95-897b-4e83-89ba-c486aa086dc1 from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:57:27 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:27 user nova-compute[75113]:   <source dev="/dev/sde"/>
Oct 26 16:57:27 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:57:27 user nova-compute[75113]:   <serial>0876d835-1ab0-4103-9353-6361c87078cc</serial>
Oct 26 16:57:27 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:57:27 user nova-compute[75113]: </disk>
Oct 26 16:57:27 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:57:27 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Successfully detached device vdb from instance f1769d95-897b-4e83-89ba-c486aa086dc1 from the persistent domain config.
Oct 26 16:57:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1769d95-897b-4e83-89ba-c486aa086dc1 from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:57:27 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:27 user nova-compute[75113]:   <source dev="/dev/sde"/>
Oct 26 16:57:27 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:57:27 user nova-compute[75113]:   <serial>0876d835-1ab0-4103-9353-6361c87078cc</serial>
Oct 26 16:57:27 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:57:27 user nova-compute[75113]: </disk>
Oct 26 16:57:27 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] No BDM found with device name sda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] No VIF found with MAC fa:16:3e:8a:91:a9, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fd10f28b-c6d1-4762-b6b9-5aeeb6c4f90d tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "af957c0b-a655-4b55-974a-70256a760d3c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 48.837s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1769d95-897b-4e83-89ba-c486aa086dc1 {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:57:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "af957c0b-a655-4b55-974a-70256a760d3c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "af957c0b-a655-4b55-974a-70256a760d3c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:28 user nova-compute[75113]: INFO nova.compute.manager [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Detaching volume c47097b2-9194-4fb6-9752-988cf51bcd25
Oct 26 16:57:28 user nova-compute[75113]: INFO nova.virt.block_device [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Attempting to driver detach volume c47097b2-9194-4fb6-9752-988cf51bcd25 from mountpoint /dev/sdc
Oct 26 16:57:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Attempting to detach device sdc from instance af957c0b-a655-4b55-974a-70256a760d3c from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:57:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:57:28 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:28 user nova-compute[75113]:   <source dev="/dev/sdf"/>
Oct 26 16:57:28 user nova-compute[75113]:   <target dev="sdc" bus="scsi"/>
Oct 26 16:57:28 user nova-compute[75113]:   <serial>c47097b2-9194-4fb6-9752-988cf51bcd25</serial>
Oct 26 16:57:28 user nova-compute[75113]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 26 16:57:28 user nova-compute[75113]: </disk>
Oct 26 16:57:28 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:57:28 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Successfully detached device sdc from instance af957c0b-a655-4b55-974a-70256a760d3c from the persistent domain config.
Oct 26 16:57:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance af957c0b-a655-4b55-974a-70256a760d3c from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:57:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:57:28 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:28 user nova-compute[75113]:   <source dev="/dev/sdf"/>
Oct 26 16:57:28 user nova-compute[75113]:   <target dev="sdc" bus="scsi"/>
Oct 26 16:57:28 user nova-compute[75113]:   <serial>c47097b2-9194-4fb6-9752-988cf51bcd25</serial>
Oct 26 16:57:28 user nova-compute[75113]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 26 16:57:28 user nova-compute[75113]: </disk>
Oct 26 16:57:28 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:57:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance af957c0b-a655-4b55-974a-70256a760d3c {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:57:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-0d813276-91b5-4df7-b9c7-acaf419a2a36 req-50015936-1dd1-4046-be8d-d4b3f6cd3fd5 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Received event network-vif-plugged-c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0d813276-91b5-4df7-b9c7-acaf419a2a36 req-50015936-1dd1-4046-be8d-d4b3f6cd3fd5 service nova] Acquiring lock "cafa9881-242a-4275-8125-80f415d56ee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0d813276-91b5-4df7-b9c7-acaf419a2a36 req-50015936-1dd1-4046-be8d-d4b3f6cd3fd5 service nova] Lock "cafa9881-242a-4275-8125-80f415d56ee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0d813276-91b5-4df7-b9c7-acaf419a2a36 req-50015936-1dd1-4046-be8d-d4b3f6cd3fd5 service nova] Lock "cafa9881-242a-4275-8125-80f415d56ee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-0d813276-91b5-4df7-b9c7-acaf419a2a36 req-50015936-1dd1-4046-be8d-d4b3f6cd3fd5 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] No waiting events found dispatching network-vif-plugged-c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:29 user nova-compute[75113]: WARNING nova.compute.manager [req-0d813276-91b5-4df7-b9c7-acaf419a2a36 req-50015936-1dd1-4046-be8d-d4b3f6cd3fd5 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Received unexpected event network-vif-plugged-c7b6c1aa-2d23-4be9-add7-b54f42557d05 for instance with vm_state building and task_state spawning.
Oct 26 16:57:29 user nova-compute[75113]: DEBUG nova.compute.manager [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:57:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:57:29 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Instance spawned successfully.
Oct 26 16:57:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:57:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:57:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:57:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:57:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:57:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:57:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:57:29 user nova-compute[75113]: INFO nova.compute.manager [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Took 6.07 seconds to spawn the instance on the hypervisor.
Oct 26 16:57:29 user nova-compute[75113]: DEBUG nova.compute.manager [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:57:30 user nova-compute[75113]: INFO nova.compute.manager [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Took 7.12 seconds to build instance.
Oct 26 16:57:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-305b3aef-0bf8-4b71-8dcd-1918bc3d9bfe tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "cafa9881-242a-4275-8125-80f415d56ee8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.296s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-8a719e50-51a9-432f-ade5-add8b182f11b req-93682623-45fa-4364-a74c-3c30d077940c service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Received event network-changed-52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-8a719e50-51a9-432f-ade5-add8b182f11b req-93682623-45fa-4364-a74c-3c30d077940c service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Refreshing instance network info cache due to event network-changed-52953b56-70f6-4307-9368-7622665234cb. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:57:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8a719e50-51a9-432f-ade5-add8b182f11b req-93682623-45fa-4364-a74c-3c30d077940c service nova] Acquiring lock "refresh_cache-a8368686-8c4d-4373-a3a5-4498e2086e0d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:57:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8a719e50-51a9-432f-ade5-add8b182f11b req-93682623-45fa-4364-a74c-3c30d077940c service nova] Acquired lock "refresh_cache-a8368686-8c4d-4373-a3a5-4498e2086e0d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:57:34 user nova-compute[75113]: DEBUG nova.network.neutron [req-8a719e50-51a9-432f-ade5-add8b182f11b req-93682623-45fa-4364-a74c-3c30d077940c service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Refreshing network info cache for port 52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "a8368686-8c4d-4373-a3a5-4498e2086e0d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG nova.objects.instance [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lazy-loading 'flavor' on Instance uuid a8368686-8c4d-4373-a3a5-4498e2086e0d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:35 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Ignoring supplied device name: /dev/vdb
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG nova.network.neutron [req-8a719e50-51a9-432f-ade5-add8b182f11b req-93682623-45fa-4364-a74c-3c30d077940c service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Updated VIF entry in instance network info cache for port 52953b56-70f6-4307-9368-7622665234cb. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG nova.network.neutron [req-8a719e50-51a9-432f-ade5-add8b182f11b req-93682623-45fa-4364-a74c-3c30d077940c service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Updating instance_info_cache with network_info: [{"id": "52953b56-70f6-4307-9368-7622665234cb", "address": "fa:16:3e:ef:35:6f", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52953b56-70", "ovs_interfaceid": "52953b56-70f6-4307-9368-7622665234cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8a719e50-51a9-432f-ade5-add8b182f11b req-93682623-45fa-4364-a74c-3c30d077940c service nova] Releasing lock "refresh_cache-a8368686-8c4d-4373-a3a5-4498e2086e0d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "a8368686-8c4d-4373-a3a5-4498e2086e0d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:35 user nova-compute[75113]: INFO nova.compute.manager [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Attaching volume bb2ce461-85ab-48ec-8e70-12e430af9a9e to /dev/vdb
Oct 26 16:57:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG os_brick.utils [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae381a8-15b6-4c97-9d5c-db136e195655]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58097af-fa00-413b-a1ed-11364d33558c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[92adf4f0-0c03-45d7-ad13-ef84f352e77c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb55645-b5a8-4efb-8b45-276e6d5fcea5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:57:35 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:57:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a1462a-e650-485f-b16d-5a3fd9b87105]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG os_brick.utils [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Updating existing volume attachment record: 1c495450-17ad-41eb-a511-5b863a7ed884 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:57:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.compute.manager [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:57:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Creating image(s)
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Ensure instance console log exists: /opt/stack/data/nova/instances/8d18f293-ebac-4392-9405-869a7e23f3e0/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Start _get_guest_xml network_info=[{"id": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "address": "fa:16:3e:5e:8d:bb", "network": {"id": "c2e7c5c6-ced3-44f1-baed-3115ab05a814", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-903346093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbfd85e-68", "ovs_interfaceid": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "address": "fa:16:3e:b0:1c:4e", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ec1e1-94", "ovs_interfaceid": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "address": "fa:16:3e:66:64:d7", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46d4142-9e", "ovs_interfaceid": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "address": "fa:16:3e:c8:73:3b", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2c1443-f5", "ovs_interfaceid": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "address": "fa:16:3e:09:04:3c", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d92159e-2e", "ovs_interfaceid": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "address": "fa:16:3e:0d:40:0f", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d4dd71-2d", "ovs_interfaceid": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "address": "fa:16:3e:dc:3e:7d", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4355f4f-05", "ovs_interfaceid": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2760ec08-bd26-4f47-b3eb-7321dab4c9e6', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OurNYSXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d18f293-ebac-4392-9405-869a7e23f3e0', 'attached_at': '', 'detached_at': '', 'volume_id': 'f451bb25-be49-4269-b788-16b1a0b42aac', 'serial': 'f451bb25-be49-4269-b788-16b1a0b42aac'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None}, {'attachment_id': '341ab95b-7cdb-456b-b5d7-6925bdb367b5', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FexGqsnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d18f293-ebac-4392-9405-869a7e23f3e0', 'attached_at': '', 'detached_at': '', 'volume_id': '9241a060-213c-4215-8885-59d29315ca6f', 'serial': '9241a060-213c-4215-8885-59d29315ca6f'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 1, 'mount_device': '/dev/vdb', 'volume_type': None}, {'attachment_id': '1bf801d6-852b-4d51-aad2-e8c28128be6b', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpKMgVkG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d18f293-ebac-4392-9405-869a7e23f3e0', 'attached_at': '', 'detached_at': '', 'volume_id': '744f5bef-bbc8-48f4-9376-4ed4731670d7', 'serial': '744f5bef-bbc8-48f4-9376-4ed4731670d7'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 2, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:57:42 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:57:42 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OurNYSXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:42 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:42 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:42 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2353fae-02d5-4306-9414-ed9915c59780]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:57:42 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f356191e-9085-45f1-9b70-db7b5a922885]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac] added
Oct 26 16:57:42 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55a706e-4f9a-4e2b-b518-5e0726210d37]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de5a810-7c78-4443-be92-eabf07e3a235]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OurNYSXl {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OurNYSXl" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d020dcd2-1d2f-4cfb-a006-b5721ebec039]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OurNYSXl'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f14917-dbb4-437b-b0c3-2cfebb9d66b7]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b98c07-5d9a-465a-84ff-fabff6155cb1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:42 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:42 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --login" returned: 0 in 0.125s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea09dc21-e83c-4b0b-be90-cc78f743fd1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac, portal: 172.16.0.220,3260]
Oct 26 16:57:42 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac, portal: 172.16.0.220,3260] successful.
Oct 26 16:57:42 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[af88cbb1-3403-4981-9c7a-a14ab1a94a3f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6758d38-eff1-4e01-a438-c0d37994fe36]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:42 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:42 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:42 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c57273-9509-49e4-9536-ddb5439c377c]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OurNYSXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:57:42 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9064edf2-de11-4223-baed-d346bfe34fcc is timed out.
Oct 26 16:57:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Successfully detached device vdb from instance 9064edf2-de11-4223-baed-d346bfe34fcc from the live domain config.
Oct 26 16:57:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIubCUwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:42 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:43 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e632e8ad-6d44-4a57-a04b-342bdf513260 is timed out.
Oct 26 16:57:43 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Successfully detached device vdb from instance e632e8ad-6d44-4a57-a04b-342bdf513260 from the live domain config.
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23735643364346137', 'path': '/dev/sdg'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735643364346137', 'path': '/dev/sdg'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.932s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaZkRNGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:43 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d5ae20-dccc-4730-891c-5628198fdd63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:57:43 user nova-compute[75113]: No targets found.
Oct 26 16:57:43 user nova-compute[75113]: iSNS:
Oct 26 16:57:43 user nova-compute[75113]: No targets found.
Oct 26 16:57:43 user nova-compute[75113]: STATIC:
Oct 26 16:57:43 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc
Oct 26 16:57:43 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:43 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:43 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8
Oct 26 16:57:43 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:43 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:43 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac
Oct 26 16:57:43 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:43 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:43 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08
Oct 26 16:57:43 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:43 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:43 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25
Oct 26 16:57:43 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:43 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:43 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f
Oct 26 16:57:43 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:43 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:43 user nova-compute[75113]: FIRMWARE:
Oct 26 16:57:43 user nova-compute[75113]: No targets found.
Oct 26 16:57:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:57:43 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:57:43 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FexGqsnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:43 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dba4d0-6ed7-4efa-9b70-2c00cfe51029]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1b768b-3604-424c-a37b-41e93673caa4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:43 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:43 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:43 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:43 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:43 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:43 user nova-compute[75113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f (non-flash)
Oct 26 16:57:43 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:43 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:43 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:43 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914356b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f'): ({'sdd'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Removing single pathed devices sdd {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c877e667-6935-43cc-837d-51ce9bdefc80]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0554928d-4916-49a3-af76-bb4051fb65f5]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Flushing IO for device /dev/sdd {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f37e3b-2dc7-4021-8d01-3ca3a3851657]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0420fe-ca1d-4d7e-958c-1fa051b7005e]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] SCSI volumes sdd have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.066s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07810e3-519d-4da7-91b5-185776da6a9e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4653cdd-8162-4e39-ad84-eee8c44ae189]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f, portal: 172.16.0.220,3260]
Oct 26 16:57:44 user nova-compute[75113]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f, portal: 172.16.0.220,3260] successful.
Oct 26 16:57:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c02300-9bdc-4407-af6b-163ff3803a7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2836e524-5a24-4a27-a620-8fb823ee6807]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] <== disconnect_volume: return (1357ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.430s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca709a0-1e08-48aa-9f0d-dd6cf269e6a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:57:44 user nova-compute[75113]: No targets found.
Oct 26 16:57:44 user nova-compute[75113]: iSNS:
Oct 26 16:57:44 user nova-compute[75113]: No targets found.
Oct 26 16:57:44 user nova-compute[75113]: STATIC:
Oct 26 16:57:44 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc
Oct 26 16:57:44 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:44 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:44 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8
Oct 26 16:57:44 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:44 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:44 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac
Oct 26 16:57:44 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:44 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:44 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08
Oct 26 16:57:44 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:44 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:44 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25
Oct 26 16:57:44 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:44 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:44 user nova-compute[75113]: FIRMWARE:
Oct 26 16:57:44 user nova-compute[75113]: No targets found.
Oct 26 16:57:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:57:44 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:57:44 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eea5c9-9938-4dd9-a9e1-80eeb06707cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7393a5e8-dcfa-408b-a985-7ba867357160]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914706200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa1178e-f09d-4fcd-8a93-7a92cec57554]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8f4d6d-7028-4d18-8556-342a76c21bf3]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[855468a1-df23-4ef7-ae49-eb4e89291701]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28377ff-a725-43e2-b18e-e590c6200389]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3b9135-6018-4863-8921-628aa9778958]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0a29cf-96f6-4dff-905e-6d1b44a859ba]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8, portal: 172.16.0.220,3260]
Oct 26 16:57:44 user nova-compute[75113]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8, portal: 172.16.0.220,3260] successful.
Oct 26 16:57:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:389de90c-9f08-4f96-aa61-6e14d723a2b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8deb6d-cbba-417e-83f6-931b66624d18]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] <== disconnect_volume: return (779ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.748s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:44 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:44 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebfbce2-b7fa-4b22-b379-29ac4622339d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:57:44 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fb9bd5-a431-4b77-a3f5-a8869f91c72b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f] added
Oct 26 16:57:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ab7945-81f7-461d-aac0-e071d6ba6dcc]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[178a6bd1-c1fb-4dd2-8384-14bdc064751b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FexGqsnu {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FexGqsnu" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5751df-3d86-46a5-81d6-51b03b635e43]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FexGqsnu'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f573740c-7bf4-4ecd-8ec9-1cec3674180c]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8379bdcd-a1bf-4aa0-94ac-9b5b12996e55]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1cde7f-395b-42c0-95e2-75ad4d071502]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f, portal: 172.16.0.220,3260]
Oct 26 16:57:44 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f, portal: 172.16.0.220,3260] successful.
Oct 26 16:57:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0731d48c-b339-4e41-a004-b3be96b7ccf3]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abdb964-419c-4392-9ed4-452dc93d3d5a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:57:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:44 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:57:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b82e38f-4f0b-4852-a6f0-dba540c856ed]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.objects.instance [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lazy-loading 'flavor' on Instance uuid 9064edf2-de11-4223-baed-d346bfe34fcc {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3cb5bf39-83fd-473d-9a35-d00d5d199be1 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "9064edf2-de11-4223-baed-d346bfe34fcc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.086s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.volume.cinder [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Update attachment failed for attachment 1c495450-17ad-41eb-a511-5b863a7ed884. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f4938faa-e2bd-42ad-b1bd-f70dba0f1378) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f4938faa-e2bd-42ad-b1bd-f70dba0f1378)
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Failed to attach bb2ce461-85ab-48ec-8e70-12e430af9a9e at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f4938faa-e2bd-42ad-b1bd-f70dba0f1378)
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Traceback (most recent call last):
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     ret_val = method(obj, context, *args, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     self._do_attach(context, instance, volume, volume_api,
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     self._volume_attach(context, volume, connector, instance,
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     connection_info = volume_api.attachment_update(
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     res = method(self, ctx, *args, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     with excutils.save_and_reraise_exception():
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     self.force_reraise()
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     raise self.value
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     return method.func(obj, *args, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     resp = self._update('/attachments/%s' % id, body)
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     return self.request(url, method, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d]     raise exceptions.from_response(resp, body)
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f4938faa-e2bd-42ad-b1bd-f70dba0f1378)
Oct 26 16:57:45 user nova-compute[75113]: ERROR nova.compute.manager [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] 
Oct 26 16:57:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "interface-9064edf2-de11-4223-baed-d346bfe34fcc-528921b8-dc12-49ae-844c-26313949e09e" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "interface-9064edf2-de11-4223-baed-d346bfe34fcc-528921b8-dc12-49ae-844c-26313949e09e" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.objects.instance [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lazy-loading 'flavor' on Instance uuid 9064edf2-de11-4223-baed-d346bfe34fcc {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1384773775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1384773775',id=8,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESp5K/14Ggl6vrqYPJZwPerrbYDesNlYVE2P8OiIAmeuCFyfagPIf0wDUE44PKomsOLEBGK5zvmXNCoV246gjfXa+oGWMEfMNs4yKfAzQiMGQTrxjH+/YVUO6sO4X+6vw==',key_name='tempest-keypair-1710846497',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87c7a88071a24c96abb06407c59a2775',ramdisk_id='',reservation_id='r-0pxw2si0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-508694228',owner_user_name='tempest-TaggedAttachmentsTest-508694228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3b34c772fc54da89ff6787f12fef797',uuid=9064edf2-de11-4223-baed-d346bfe34fcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converting VIF {"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:25:b9,bridge_name='br-int',has_traffic_filtering=True,id=528921b8-dc12-49ae-844c-26313949e09e,network=Network(891dc6b2-cbc0-4f37-b84b-0e618790a183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528921b8-dc') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:79:25:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tap528921b8-dc"/></interface> {{(pid=75113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:79:25:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tap528921b8-dc"/></interface> {{(pid=75113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Attempting to detach device tap528921b8-dc from instance 9064edf2-de11-4223-baed-d346bfe34fcc from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] detach device xml: <interface type="ethernet">
Oct 26 16:57:45 user nova-compute[75113]:   <mac address="fa:16:3e:79:25:b9"/>
Oct 26 16:57:45 user nova-compute[75113]:   <model type="virtio"/>
Oct 26 16:57:45 user nova-compute[75113]:   <mtu size="1442"/>
Oct 26 16:57:45 user nova-compute[75113]:   <target dev="tap528921b8-dc"/>
Oct 26 16:57:45 user nova-compute[75113]: </interface>
Oct 26 16:57:45 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:79:25:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tap528921b8-dc"/></interface> {{(pid=75113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:79:25:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tap528921b8-dc"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 26 16:57:45 user nova-compute[75113]:   <name>instance-00000008</name>
Oct 26 16:57:45 user nova-compute[75113]:   <uuid>9064edf2-de11-4223-baed-d346bfe34fcc</uuid>
Oct 26 16:57:45 user nova-compute[75113]:   <metadata>
Oct 26 16:57:45 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:57:45 user nova-compute[75113]:   <nova:package version="0.0.0"/>
Oct 26 16:57:45 user nova-compute[75113]:   <nova:name>tempest-device-tagging-server-1384773775</nova:name>
Oct 26 16:57:45 user nova-compute[75113]:   <nova:creationTime>2023-10-26 16:56:36</nova:creationTime>
Oct 26 16:57:45 user nova-compute[75113]:   <nova:flavor name="m1.tiny">
Oct 26 16:57:45 user nova-compute[75113]:     <nova:memory>512</nova:memory>
Oct 26 16:57:45 user nova-compute[75113]:     <nova:disk>1</nova:disk>
Oct 26 16:57:45 user nova-compute[75113]:     <nova:swap>0</nova:swap>
Oct 26 16:57:45 user nova-compute[75113]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:57:45 user nova-compute[75113]:     <nova:vcpus>1</nova:vcpus>
Oct 26 16:57:45 user nova-compute[75113]:   </nova:flavor>
Oct 26 16:57:45 user nova-compute[75113]:   <nova:owner>
Oct 26 16:57:45 user nova-compute[75113]:     <nova:user uuid="c3b34c772fc54da89ff6787f12fef797">tempest-TaggedAttachmentsTest-508694228-project-member</nova:user>
Oct 26 16:57:45 user nova-compute[75113]:     <nova:project uuid="87c7a88071a24c96abb06407c59a2775">tempest-TaggedAttachmentsTest-508694228</nova:project>
Oct 26 16:57:45 user nova-compute[75113]:   </nova:owner>
Oct 26 16:57:45 user nova-compute[75113]:   <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:57:45 user nova-compute[75113]:   <nova:ports>
Oct 26 16:57:45 user nova-compute[75113]:     <nova:port uuid="b55efe74-8efe-4e0d-a917-a9c47cae9a85">
Oct 26 16:57:45 user nova-compute[75113]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 16:57:45 user nova-compute[75113]:     </nova:port>
Oct 26 16:57:45 user nova-compute[75113]:     <nova:port uuid="528921b8-dc12-49ae-844c-26313949e09e">
Oct 26 16:57:45 user nova-compute[75113]:       <nova:ip type="fixed" address="10.10.10.18" ipVersion="4"/>
Oct 26 16:57:45 user nova-compute[75113]:     </nova:port>
Oct 26 16:57:45 user nova-compute[75113]:   </nova:ports>
Oct 26 16:57:45 user nova-compute[75113]: </nova:instance>
Oct 26 16:57:45 user nova-compute[75113]:   </metadata>
Oct 26 16:57:45 user nova-compute[75113]:   <memory unit='KiB'>524288</memory>
Oct 26 16:57:45 user nova-compute[75113]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 16:57:45 user nova-compute[75113]:   <vcpu placement='static'>1</vcpu>
Oct 26 16:57:45 user nova-compute[75113]:   <resource>
Oct 26 16:57:45 user nova-compute[75113]:     <partition>/machine</partition>
Oct 26 16:57:45 user nova-compute[75113]:   </resource>
Oct 26 16:57:45 user nova-compute[75113]:   <sysinfo type='smbios'>
Oct 26 16:57:45 user nova-compute[75113]:     <system>
Oct 26 16:57:45 user nova-compute[75113]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 16:57:45 user nova-compute[75113]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 16:57:45 user nova-compute[75113]:       <entry name='version'>0.0.0</entry>
Oct 26 16:57:45 user nova-compute[75113]:       <entry name='serial'>9064edf2-de11-4223-baed-d346bfe34fcc</entry>
Oct 26 16:57:45 user nova-compute[75113]:       <entry name='uuid'>9064edf2-de11-4223-baed-d346bfe34fcc</entry>
Oct 26 16:57:45 user nova-compute[75113]:       <entry name='family'>Virtual Machine</entry>
Oct 26 16:57:45 user nova-compute[75113]:     </system>
Oct 26 16:57:45 user nova-compute[75113]:   </sysinfo>
Oct 26 16:57:45 user nova-compute[75113]:   <os>
Oct 26 16:57:45 user nova-compute[75113]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 16:57:45 user nova-compute[75113]:     <boot dev='hd'/>
Oct 26 16:57:45 user nova-compute[75113]:     <smbios mode='sysinfo'/>
Oct 26 16:57:45 user nova-compute[75113]:   </os>
Oct 26 16:57:45 user nova-compute[75113]:   <features>
Oct 26 16:57:45 user nova-compute[75113]:     <acpi/>
Oct 26 16:57:45 user nova-compute[75113]:     <apic/>
Oct 26 16:57:45 user nova-compute[75113]:     <vmcoreinfo state='on'/>
Oct 26 16:57:45 user nova-compute[75113]:   </features>
Oct 26 16:57:45 user nova-compute[75113]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 16:57:45 user nova-compute[75113]:     <model fallback='forbid'>Nehalem</model>
Oct 26 16:57:45 user nova-compute[75113]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 16:57:45 user nova-compute[75113]:     <feature policy='require' name='vme'/>
Oct 26 16:57:45 user nova-compute[75113]:     <feature policy='require' name='x2apic'/>
Oct 26 16:57:45 user nova-compute[75113]:     <feature policy='require' name='hypervisor'/>
Oct 26 16:57:45 user nova-compute[75113]:   </cpu>
Oct 26 16:57:45 user nova-compute[75113]:   <clock offset='utc'>
Oct 26 16:57:45 user nova-compute[75113]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 16:57:45 user nova-compute[75113]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 16:57:45 user nova-compute[75113]:     <timer name='hpet' present='no'/>
Oct 26 16:57:45 user nova-compute[75113]:   </clock>
Oct 26 16:57:45 user nova-compute[75113]:   <on_poweroff>destroy</on_poweroff>
Oct 26 16:57:45 user nova-compute[75113]:   <on_reboot>restart</on_reboot>
Oct 26 16:57:45 user nova-compute[75113]:   <on_crash>destroy</on_crash>
Oct 26 16:57:45 user nova-compute[75113]:   <devices>
Oct 26 16:57:45 user nova-compute[75113]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 16:57:45 user nova-compute[75113]:     <disk type='file' device='disk'>
Oct 26 16:57:45 user nova-compute[75113]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 16:57:45 user nova-compute[75113]:       <source file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk' index='2'/>
Oct 26 16:57:45 user nova-compute[75113]:       <backingStore type='file' index='3'>
Oct 26 16:57:45 user nova-compute[75113]:         <format type='raw'/>
Oct 26 16:57:45 user nova-compute[75113]:         <source file='/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0'/>
Oct 26 16:57:45 user nova-compute[75113]:         <backingStore/>
Oct 26 16:57:45 user nova-compute[75113]:       </backingStore>
Oct 26 16:57:45 user nova-compute[75113]:       <target dev='vda' bus='virtio'/>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='virtio-disk0'/>
Oct 26 16:57:45 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 16:57:45 user nova-compute[75113]:     </disk>
Oct 26 16:57:45 user nova-compute[75113]:     <disk type='file' device='cdrom'>
Oct 26 16:57:45 user nova-compute[75113]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 16:57:45 user nova-compute[75113]:       <source file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk.config' index='1'/>
Oct 26 16:57:45 user nova-compute[75113]:       <backingStore/>
Oct 26 16:57:45 user nova-compute[75113]:       <target dev='hda' bus='ide'/>
Oct 26 16:57:45 user nova-compute[75113]:       <readonly/>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='ide0-0-0'/>
Oct 26 16:57:45 user nova-compute[75113]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 16:57:45 user nova-compute[75113]:     </disk>
Oct 26 16:57:45 user nova-compute[75113]:     <controller type='usb' index='0' model='none'>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='usb'/>
Oct 26 16:57:45 user nova-compute[75113]:     </controller>
Oct 26 16:57:45 user nova-compute[75113]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='pci.0'/>
Oct 26 16:57:45 user nova-compute[75113]:     </controller>
Oct 26 16:57:45 user nova-compute[75113]:     <controller type='ide' index='0'>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='ide'/>
Oct 26 16:57:45 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 16:57:45 user nova-compute[75113]:     </controller>
Oct 26 16:57:45 user nova-compute[75113]:     <interface type='ethernet'>
Oct 26 16:57:45 user nova-compute[75113]:       <mac address='fa:16:3e:84:a4:ac'/>
Oct 26 16:57:45 user nova-compute[75113]:       <target dev='tapb55efe74-8e'/>
Oct 26 16:57:45 user nova-compute[75113]:       <model type='virtio'/>
Oct 26 16:57:45 user nova-compute[75113]:       <mtu size='1442'/>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='net0'/>
Oct 26 16:57:45 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 16:57:45 user nova-compute[75113]:     </interface>
Oct 26 16:57:45 user nova-compute[75113]:     <interface type='ethernet'>
Oct 26 16:57:45 user nova-compute[75113]:       <mac address='fa:16:3e:79:25:b9'/>
Oct 26 16:57:45 user nova-compute[75113]:       <target dev='tap528921b8-dc'/>
Oct 26 16:57:45 user nova-compute[75113]:       <model type='virtio'/>
Oct 26 16:57:45 user nova-compute[75113]:       <mtu size='1442'/>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='net1'/>
Oct 26 16:57:45 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 26 16:57:45 user nova-compute[75113]:     </interface>
Oct 26 16:57:45 user nova-compute[75113]:     <serial type='pty'>
Oct 26 16:57:45 user nova-compute[75113]:       <source path='/dev/pts/7'/>
Oct 26 16:57:45 user nova-compute[75113]:       <log file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/console.log' append='off'/>
Oct 26 16:57:45 user nova-compute[75113]:       <target type='isa-serial' port='0'>
Oct 26 16:57:45 user nova-compute[75113]:         <model name='isa-serial'/>
Oct 26 16:57:45 user nova-compute[75113]:       </target>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='serial0'/>
Oct 26 16:57:45 user nova-compute[75113]:     </serial>
Oct 26 16:57:45 user nova-compute[75113]:     <console type='pty' tty='/dev/pts/7'>
Oct 26 16:57:45 user nova-compute[75113]:       <source path='/dev/pts/7'/>
Oct 26 16:57:45 user nova-compute[75113]:       <log file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/console.log' append='off'/>
Oct 26 16:57:45 user nova-compute[75113]:       <target type='serial' port='0'/>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='serial0'/>
Oct 26 16:57:45 user nova-compute[75113]:     </console>
Oct 26 16:57:45 user nova-compute[75113]:     <input type='mouse' bus='ps2'>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='input0'/>
Oct 26 16:57:45 user nova-compute[75113]:     </input>
Oct 26 16:57:45 user nova-compute[75113]:     <input type='keyboard' bus='ps2'>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='input1'/>
Oct 26 16:57:45 user nova-compute[75113]:     </input>
Oct 26 16:57:45 user nova-compute[75113]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 26 16:57:45 user nova-compute[75113]:       <listen type='address' address='0.0.0.0'/>
Oct 26 16:57:45 user nova-compute[75113]:     </graphics>
Oct 26 16:57:45 user nova-compute[75113]:     <audio id='1' type='none'/>
Oct 26 16:57:45 user nova-compute[75113]:     <video>
Oct 26 16:57:45 user nova-compute[75113]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='video0'/>
Oct 26 16:57:45 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 16:57:45 user nova-compute[75113]:     </video>
Oct 26 16:57:45 user nova-compute[75113]:     <memballoon model='virtio'>
Oct 26 16:57:45 user nova-compute[75113]:       <stats period='10'/>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='balloon0'/>
Oct 26 16:57:45 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 16:57:45 user nova-compute[75113]:     </memballoon>
Oct 26 16:57:45 user nova-compute[75113]:     <rng model='virtio'>
Oct 26 16:57:45 user nova-compute[75113]:       <backend model='random'>/dev/urandom</backend>
Oct 26 16:57:45 user nova-compute[75113]:       <alias name='rng0'/>
Oct 26 16:57:45 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 16:57:45 user nova-compute[75113]:     </rng>
Oct 26 16:57:45 user nova-compute[75113]:   </devices>
Oct 26 16:57:45 user nova-compute[75113]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 16:57:45 user nova-compute[75113]:     <label>libvirt-9064edf2-de11-4223-baed-d346bfe34fcc</label>
Oct 26 16:57:45 user nova-compute[75113]:     <imagelabel>libvirt-9064edf2-de11-4223-baed-d346bfe34fcc</imagelabel>
Oct 26 16:57:45 user nova-compute[75113]:   </seclabel>
Oct 26 16:57:45 user nova-compute[75113]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 16:57:45 user nova-compute[75113]:     <label>+64055:+108</label>
Oct 26 16:57:45 user nova-compute[75113]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 16:57:45 user nova-compute[75113]:   </seclabel>
Oct 26 16:57:45 user nova-compute[75113]: </domain>
Oct 26 16:57:45 user nova-compute[75113]:  {{(pid=75113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 16:57:45 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Successfully detached device tap528921b8-dc from instance 9064edf2-de11-4223-baed-d346bfe34fcc from the persistent domain config.
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] (1/8): Attempting to detach device tap528921b8-dc with device alias net1 from instance 9064edf2-de11-4223-baed-d346bfe34fcc from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] detach device xml: <interface type="ethernet">
Oct 26 16:57:45 user nova-compute[75113]:   <mac address="fa:16:3e:79:25:b9"/>
Oct 26 16:57:45 user nova-compute[75113]:   <model type="virtio"/>
Oct 26 16:57:45 user nova-compute[75113]:   <mtu size="1442"/>
Oct 26 16:57:45 user nova-compute[75113]:   <target dev="tap528921b8-dc"/>
Oct 26 16:57:45 user nova-compute[75113]: </interface>
Oct 26 16:57:45 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.318s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FexGqsnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] <== connect_volume: return (2079ms) {'type': 'block', 'scsi_wwn': '23961613035643634', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961613035643634', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server [None req-7c2799c0-f379-4ae3-a3e6-ee393de780f8 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f4938faa-e2bd-42ad-b1bd-f70dba0f1378)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f4938faa-e2bd-42ad-b1bd-f70dba0f1378)
Oct 26 16:57:45 user nova-compute[75113]: ERROR oslo_messaging.rpc.server 
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpKMgVkG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:45 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:45 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:45 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93ca56e-72aa-4280-919b-0222ffe10e82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:57:45 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[404d253a-3703-4354-bc68-f4831b1f5b3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7] added
Oct 26 16:57:45 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7d0bfe-728d-47ca-8c77-5499daef1a0c]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1f147c-703f-4499-a308-9931b14a83ad]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpKMgVkG {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG nova.objects.instance [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lazy-loading 'flavor' on Instance uuid e632e8ad-6d44-4a57-a04b-342bdf513260 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpKMgVkG" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ce7cb0-e99a-4a89-8dce-d05eb1f5e30d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rpKMgVkG'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15d5a1d-333d-477b-b9f5-2e18e3238a4f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d80c982-53f8-4b55-ac70-543509178b03]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:57:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:57:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-eadc2fec-0a7c-4c78-aea7-dbc6fd8462fd tempest-VolumesAssistedSnapshotsTest-1921848461 tempest-VolumesAssistedSnapshotsTest-1921848461-project-admin] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.150s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Start waiting for the detach event from libvirt for device tap528921b8-dc with device alias net1 for instance 9064edf2-de11-4223-baed-d346bfe34fcc {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec1f626-7fb2-40f9-88a1-85fdac45624a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7, portal: 172.16.0.220,3260]
Oct 26 16:57:46 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7, portal: 172.16.0.220,3260] successful.
Oct 26 16:57:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae5f66f-d737-48a1-bce3-a906564eae98]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[595d82fe-8fe5-434d-a382-f6f770cf0538]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:57:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:46 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:57:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-f26a4ce4-00f4-4eec-9ffb-3000ccb30a8f req-3701ce95-7c2b-4189-8270-8e01c2523877 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-vif-unplugged-528921b8-dc12-49ae-844c-26313949e09e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f26a4ce4-00f4-4eec-9ffb-3000ccb30a8f req-3701ce95-7c2b-4189-8270-8e01c2523877 service nova] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f26a4ce4-00f4-4eec-9ffb-3000ccb30a8f req-3701ce95-7c2b-4189-8270-8e01c2523877 service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f26a4ce4-00f4-4eec-9ffb-3000ccb30a8f req-3701ce95-7c2b-4189-8270-8e01c2523877 service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-f26a4ce4-00f4-4eec-9ffb-3000ccb30a8f req-3701ce95-7c2b-4189-8270-8e01c2523877 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] No waiting events found dispatching network-vif-unplugged-528921b8-dc12-49ae-844c-26313949e09e {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:46 user nova-compute[75113]: WARNING nova.compute.manager [req-f26a4ce4-00f4-4eec-9ffb-3000ccb30a8f req-3701ce95-7c2b-4189-8270-8e01c2523877 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received unexpected event network-vif-unplugged-528921b8-dc12-49ae-844c-26313949e09e for instance with vm_state active and task_state None.
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[88766186-caaf-41f8-bd60-2e620c73201b]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:57:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpKMgVkG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.volume.cinder [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] Update attachment failed for attachment 3b249b9b-b6ea-4268-a44e-7799f02981fa. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a70270e6-1735-4adc-a89d-a2a4fab4384f) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a70270e6-1735-4adc-a89d-a2a4fab4384f)
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Failed to connect to volume 7d3ccee2-e704-4123-9238-ac5751294209 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a70270e6-1735-4adc-a89d-a2a4fab4384f)
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Traceback (most recent call last):
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     new_cinfo = self.volume_api.attachment_update(
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     res = method(self, ctx, *args, **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     with excutils.save_and_reraise_exception():
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     self.force_reraise()
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     raise self.value
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     return method.func(obj, *args, **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     resp = self._update('/attachments/%s' % id, body)
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     return self.request(url, method, **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f]     raise exceptions.from_response(resp, body)
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a70270e6-1735-4adc-a89d-a2a4fab4384f)
Oct 26 16:57:46 user nova-compute[75113]: ERROR nova.compute.manager [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] 
Oct 26 16:57:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 24.232s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server [None req-0f80786d-26f8-4c29-bed9-caba75b2e9d9 tempest-TestVolumeSwap-2099695773 tempest-TestVolumeSwap-2099695773-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a70270e6-1735-4adc-a89d-a2a4fab4384f)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7902, in swap_volume
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7900, in _do_locked_swap_volume
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7944, in _do_swap_volume
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7793, in _swap_volume
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a70270e6-1735-4adc-a89d-a2a4fab4384f)
Oct 26 16:57:46 user nova-compute[75113]: ERROR oslo_messaging.rpc.server 
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26361323464386139', 'path': '/dev/sdd'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361323464386139', 'path': '/dev/sdd'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "address": "fa:16:3e:5e:8d:bb", "network": {"id": "c2e7c5c6-ced3-44f1-baed-3115ab05a814", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-903346093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbfd85e-68", "ovs_interfaceid": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "address": "fa:16:3e:5e:8d:bb", "network": {"id": "c2e7c5c6-ced3-44f1-baed-3115ab05a814", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-903346093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbfd85e-68", "ovs_interfaceid": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:8d:bb,bridge_name='br-int',has_traffic_filtering=True,id=5dbfd85e-684a-4c18-b660-7491fea99a4a,network=Network(c2e7c5c6-ced3-44f1-baed-3115ab05a814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbfd85e-68') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "address": "fa:16:3e:b0:1c:4e", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ec1e1-94", "ovs_interfaceid": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "address": "fa:16:3e:b0:1c:4e", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ec1e1-94", "ovs_interfaceid": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:1c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f6ec1e1-94') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "address": "fa:16:3e:66:64:d7", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46d4142-9e", "ovs_interfaceid": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "address": "fa:16:3e:66:64:d7", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46d4142-9e", "ovs_interfaceid": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:64:d7,bridge_name='br-int',has_traffic_filtering=True,id=c46d4142-9e17-4a68-904c-f0ae8102ecc8,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc46d4142-9e') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "address": "fa:16:3e:c8:73:3b", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2c1443-f5", "ovs_interfaceid": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "address": "fa:16:3e:c8:73:3b", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2c1443-f5", "ovs_interfaceid": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:73:3b,bridge_name='br-int',has_traffic_filtering=True,id=2c2c1443-f57d-489a-a795-8ad1046af4c7,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2c1443-f5') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "address": "fa:16:3e:09:04:3c", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d92159e-2e", "ovs_interfaceid": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "address": "fa:16:3e:09:04:3c", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d92159e-2e", "ovs_interfaceid": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=9d92159e-2ef5-43c8-bb24-9d0f73a875ac,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d92159e-2e') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "address": "fa:16:3e:0d:40:0f", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d4dd71-2d", "ovs_interfaceid": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "address": "fa:16:3e:0d:40:0f", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d4dd71-2d", "ovs_interfaceid": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:40:0f,bridge_name='br-int',has_traffic_filtering=True,id=d8d4dd71-2d05-4d5a-9818-dec95781dd73,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d4dd71-2d') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "address": "fa:16:3e:dc:3e:7d", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4355f4f-05", "ovs_interfaceid": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "address": "fa:16:3e:dc:3e:7d", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4355f4f-05", "ovs_interfaceid": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d4355f4f-05b7-4b2e-afe4-af2377a4f4b6,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4355f4f-05') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.objects.instance [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d18f293-ebac-4392-9405-869a7e23f3e0 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:57:47 user nova-compute[75113]:   <uuid>8d18f293-ebac-4392-9405-869a7e23f3e0</uuid>
Oct 26 16:57:47 user nova-compute[75113]:   <name>instance-0000000a</name>
Oct 26 16:57:47 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:57:47 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:57:47 user nova-compute[75113]:   <metadata>
Oct 26 16:57:47 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:57:47 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:57:47 user nova-compute[75113]:       <nova:name>tempest-device-tagging-server-630236209</nova:name>
Oct 26 16:57:47 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:57:42</nova:creationTime>
Oct 26 16:57:47 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:57:47 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:57:47 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:57:47 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:57:47 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:57:47 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:57:47 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:57:47 user nova-compute[75113]:       <nova:owner>
Oct 26 16:57:47 user nova-compute[75113]:         <nova:user uuid="7507eb0467eb48bb94804ed84e57a42c">tempest-TaggedBootDevicesTest_v242-762168988-project-member</nova:user>
Oct 26 16:57:47 user nova-compute[75113]:         <nova:project uuid="173647d78bcc49e3ba74a76991fdb619">tempest-TaggedBootDevicesTest_v242-762168988</nova:project>
Oct 26 16:57:47 user nova-compute[75113]:       </nova:owner>
Oct 26 16:57:47 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:57:47 user nova-compute[75113]:       <nova:ports>
Oct 26 16:57:47 user nova-compute[75113]:         <nova:port uuid="5dbfd85e-684a-4c18-b660-7491fea99a4a">
Oct 26 16:57:47 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 16:57:47 user nova-compute[75113]:         </nova:port>
Oct 26 16:57:47 user nova-compute[75113]:         <nova:port uuid="5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a">
Oct 26 16:57:47 user nova-compute[75113]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Oct 26 16:57:47 user nova-compute[75113]:         </nova:port>
Oct 26 16:57:47 user nova-compute[75113]:         <nova:port uuid="c46d4142-9e17-4a68-904c-f0ae8102ecc8">
Oct 26 16:57:47 user nova-compute[75113]:           <nova:ip type="fixed" address="10.1.1.98" ipVersion="4"/>
Oct 26 16:57:47 user nova-compute[75113]:         </nova:port>
Oct 26 16:57:47 user nova-compute[75113]:         <nova:port uuid="2c2c1443-f57d-489a-a795-8ad1046af4c7">
Oct 26 16:57:47 user nova-compute[75113]:           <nova:ip type="fixed" address="10.1.1.178" ipVersion="4"/>
Oct 26 16:57:47 user nova-compute[75113]:         </nova:port>
Oct 26 16:57:47 user nova-compute[75113]:         <nova:port uuid="9d92159e-2ef5-43c8-bb24-9d0f73a875ac">
Oct 26 16:57:47 user nova-compute[75113]:           <nova:ip type="fixed" address="10.1.1.17" ipVersion="4"/>
Oct 26 16:57:47 user nova-compute[75113]:         </nova:port>
Oct 26 16:57:47 user nova-compute[75113]:         <nova:port uuid="d8d4dd71-2d05-4d5a-9818-dec95781dd73">
Oct 26 16:57:47 user nova-compute[75113]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 26 16:57:47 user nova-compute[75113]:         </nova:port>
Oct 26 16:57:47 user nova-compute[75113]:         <nova:port uuid="d4355f4f-05b7-4b2e-afe4-af2377a4f4b6">
Oct 26 16:57:47 user nova-compute[75113]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 26 16:57:47 user nova-compute[75113]:         </nova:port>
Oct 26 16:57:47 user nova-compute[75113]:       </nova:ports>
Oct 26 16:57:47 user nova-compute[75113]:     </nova:instance>
Oct 26 16:57:47 user nova-compute[75113]:   </metadata>
Oct 26 16:57:47 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:57:47 user nova-compute[75113]:     <system>
Oct 26 16:57:47 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:57:47 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:57:47 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:57:47 user nova-compute[75113]:       <entry name="serial">8d18f293-ebac-4392-9405-869a7e23f3e0</entry>
Oct 26 16:57:47 user nova-compute[75113]:       <entry name="uuid">8d18f293-ebac-4392-9405-869a7e23f3e0</entry>
Oct 26 16:57:47 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:57:47 user nova-compute[75113]:     </system>
Oct 26 16:57:47 user nova-compute[75113]:   </sysinfo>
Oct 26 16:57:47 user nova-compute[75113]:   <os>
Oct 26 16:57:47 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:57:47 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:57:47 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:57:47 user nova-compute[75113]:   </os>
Oct 26 16:57:47 user nova-compute[75113]:   <features>
Oct 26 16:57:47 user nova-compute[75113]:     <acpi/>
Oct 26 16:57:47 user nova-compute[75113]:     <apic/>
Oct 26 16:57:47 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:57:47 user nova-compute[75113]:   </features>
Oct 26 16:57:47 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:57:47 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:57:47 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:57:47 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:57:47 user nova-compute[75113]:   </clock>
Oct 26 16:57:47 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:57:47 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:57:47 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:57:47 user nova-compute[75113]:   </cpu>
Oct 26 16:57:47 user nova-compute[75113]:   <devices>
Oct 26 16:57:47 user nova-compute[75113]:     <disk type="file" device="cdrom">
Oct 26 16:57:47 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 16:57:47 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/8d18f293-ebac-4392-9405-869a7e23f3e0/disk.config"/>
Oct 26 16:57:47 user nova-compute[75113]:       <target dev="hda" bus="ide"/>
Oct 26 16:57:47 user nova-compute[75113]:     </disk>
Oct 26 16:57:47 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 16:57:47 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:47 user nova-compute[75113]:       <source dev="/dev/sdg"/>
Oct 26 16:57:47 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:57:47 user nova-compute[75113]:       <serial>f451bb25-be49-4269-b788-16b1a0b42aac</serial>
Oct 26 16:57:47 user nova-compute[75113]:     </disk>
Oct 26 16:57:47 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 16:57:47 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:47 user nova-compute[75113]:       <source dev="/dev/sdb"/>
Oct 26 16:57:47 user nova-compute[75113]:       <target dev="vdb" bus="virtio"/>
Oct 26 16:57:47 user nova-compute[75113]:       <serial>9241a060-213c-4215-8885-59d29315ca6f</serial>
Oct 26 16:57:47 user nova-compute[75113]:     </disk>
Oct 26 16:57:47 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 16:57:47 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:57:47 user nova-compute[75113]:       <source dev="/dev/sdd"/>
Oct 26 16:57:47 user nova-compute[75113]:       <target dev="vdc" bus="virtio"/>
Oct 26 16:57:47 user nova-compute[75113]:       <serial>744f5bef-bbc8-48f4-9376-4ed4731670d7</serial>
Oct 26 16:57:47 user nova-compute[75113]:     </disk>
Oct 26 16:57:47 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:57:47 user nova-compute[75113]:       <mac address="fa:16:3e:5e:8d:bb"/>
Oct 26 16:57:47 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:57:47 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:57:47 user nova-compute[75113]:       <target dev="tap5dbfd85e-68"/>
Oct 26 16:57:47 user nova-compute[75113]:     </interface>
Oct 26 16:57:47 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:57:47 user nova-compute[75113]:       <mac address="fa:16:3e:b0:1c:4e"/>
Oct 26 16:57:47 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:57:47 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:57:47 user nova-compute[75113]:       <target dev="tap5f6ec1e1-94"/>
Oct 26 16:57:47 user nova-compute[75113]:     </interface>
Oct 26 16:57:47 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:57:47 user nova-compute[75113]:       <mac address="fa:16:3e:66:64:d7"/>
Oct 26 16:57:47 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:57:47 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:57:47 user nova-compute[75113]:       <target dev="tapc46d4142-9e"/>
Oct 26 16:57:47 user nova-compute[75113]:     </interface>
Oct 26 16:57:47 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:57:47 user nova-compute[75113]:       <mac address="fa:16:3e:c8:73:3b"/>
Oct 26 16:57:47 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:57:47 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:57:47 user nova-compute[75113]:       <target dev="tap2c2c1443-f5"/>
Oct 26 16:57:47 user nova-compute[75113]:     </interface>
Oct 26 16:57:47 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:57:47 user nova-compute[75113]:       <mac address="fa:16:3e:09:04:3c"/>
Oct 26 16:57:47 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:57:47 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:57:47 user nova-compute[75113]:       <target dev="tap9d92159e-2e"/>
Oct 26 16:57:47 user nova-compute[75113]:     </interface>
Oct 26 16:57:47 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:57:47 user nova-compute[75113]:       <mac address="fa:16:3e:0d:40:0f"/>
Oct 26 16:57:47 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:57:47 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:57:47 user nova-compute[75113]:       <target dev="tapd8d4dd71-2d"/>
Oct 26 16:57:47 user nova-compute[75113]:     </interface>
Oct 26 16:57:47 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:57:47 user nova-compute[75113]:       <mac address="fa:16:3e:dc:3e:7d"/>
Oct 26 16:57:47 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:57:47 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:57:47 user nova-compute[75113]:       <target dev="tapd4355f4f-05"/>
Oct 26 16:57:47 user nova-compute[75113]:     </interface>
Oct 26 16:57:47 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:57:47 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/8d18f293-ebac-4392-9405-869a7e23f3e0/console.log" append="off"/>
Oct 26 16:57:47 user nova-compute[75113]:     </serial>
Oct 26 16:57:47 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:57:47 user nova-compute[75113]:     <video>
Oct 26 16:57:47 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:57:47 user nova-compute[75113]:     </video>
Oct 26 16:57:47 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:57:47 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:57:47 user nova-compute[75113]:     </rng>
Oct 26 16:57:47 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:57:47 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:57:47 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:57:47 user nova-compute[75113]:     </memballoon>
Oct 26 16:57:47 user nova-compute[75113]:   </devices>
Oct 26 16:57:47 user nova-compute[75113]: </domain>
Oct 26 16:57:47 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "address": "fa:16:3e:5e:8d:bb", "network": {"id": "c2e7c5c6-ced3-44f1-baed-3115ab05a814", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-903346093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbfd85e-68", "ovs_interfaceid": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "address": "fa:16:3e:5e:8d:bb", "network": {"id": "c2e7c5c6-ced3-44f1-baed-3115ab05a814", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-903346093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbfd85e-68", "ovs_interfaceid": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:8d:bb,bridge_name='br-int',has_traffic_filtering=True,id=5dbfd85e-684a-4c18-b660-7491fea99a4a,network=Network(c2e7c5c6-ced3-44f1-baed-3115ab05a814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbfd85e-68') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:8d:bb,bridge_name='br-int',has_traffic_filtering=True,id=5dbfd85e-684a-4c18-b660-7491fea99a4a,network=Network(c2e7c5c6-ced3-44f1-baed-3115ab05a814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbfd85e-68') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6704479f-f58d-59e2-8c9a-3c66bd6422eb', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dbfd85e-68, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5dbfd85e-68, col_values=(('qos', UUID('5846bf59-6099-46d4-b087-29d8aefac0e1')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5dbfd85e-68, col_values=(('external_ids', {'iface-id': '5dbfd85e-684a-4c18-b660-7491fea99a4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:8d:bb', 'vm-uuid': '8d18f293-ebac-4392-9405-869a7e23f3e0'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: INFO os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:8d:bb,bridge_name='br-int',has_traffic_filtering=True,id=5dbfd85e-684a-4c18-b660-7491fea99a4a,network=Network(c2e7c5c6-ced3-44f1-baed-3115ab05a814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbfd85e-68')
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "address": "fa:16:3e:b0:1c:4e", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ec1e1-94", "ovs_interfaceid": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "address": "fa:16:3e:b0:1c:4e", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ec1e1-94", "ovs_interfaceid": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:1c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f6ec1e1-94') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:1c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f6ec1e1-94') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '266200e0-ca2d-59ea-8d59-4cffd50cae0e', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f6ec1e1-94, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f6ec1e1-94, col_values=(('qos', UUID('3e03cc6e-1ea9-4124-951c-da46cb23c447')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f6ec1e1-94, col_values=(('external_ids', {'iface-id': '5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:1c:4e', 'vm-uuid': '8d18f293-ebac-4392-9405-869a7e23f3e0'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: INFO os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:1c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f6ec1e1-94')
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "address": "fa:16:3e:66:64:d7", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46d4142-9e", "ovs_interfaceid": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "address": "fa:16:3e:66:64:d7", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46d4142-9e", "ovs_interfaceid": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:64:d7,bridge_name='br-int',has_traffic_filtering=True,id=c46d4142-9e17-4a68-904c-f0ae8102ecc8,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc46d4142-9e') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:64:d7,bridge_name='br-int',has_traffic_filtering=True,id=c46d4142-9e17-4a68-904c-f0ae8102ecc8,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc46d4142-9e') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b4e582a-6e91-5923-aac1-2b927a2c7c1a', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc46d4142-9e, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc46d4142-9e, col_values=(('qos', UUID('69510220-8bba-4f81-aacf-0b541fe7f7fc')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc46d4142-9e, col_values=(('external_ids', {'iface-id': 'c46d4142-9e17-4a68-904c-f0ae8102ecc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:64:d7', 'vm-uuid': '8d18f293-ebac-4392-9405-869a7e23f3e0'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: INFO os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:64:d7,bridge_name='br-int',has_traffic_filtering=True,id=c46d4142-9e17-4a68-904c-f0ae8102ecc8,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc46d4142-9e')
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "address": "fa:16:3e:c8:73:3b", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2c1443-f5", "ovs_interfaceid": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "address": "fa:16:3e:c8:73:3b", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2c1443-f5", "ovs_interfaceid": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:73:3b,bridge_name='br-int',has_traffic_filtering=True,id=2c2c1443-f57d-489a-a795-8ad1046af4c7,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2c1443-f5') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:73:3b,bridge_name='br-int',has_traffic_filtering=True,id=2c2c1443-f57d-489a-a795-8ad1046af4c7,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2c1443-f5') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab7037fe-793c-560c-9ab6-dedc18903491', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c2c1443-f5, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c2c1443-f5, col_values=(('qos', UUID('189b8920-fe4e-4478-9b05-bb1db607297d')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c2c1443-f5, col_values=(('external_ids', {'iface-id': '2c2c1443-f57d-489a-a795-8ad1046af4c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:73:3b', 'vm-uuid': '8d18f293-ebac-4392-9405-869a7e23f3e0'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: INFO os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:73:3b,bridge_name='br-int',has_traffic_filtering=True,id=2c2c1443-f57d-489a-a795-8ad1046af4c7,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2c1443-f5')
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "address": "fa:16:3e:09:04:3c", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d92159e-2e", "ovs_interfaceid": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "address": "fa:16:3e:09:04:3c", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d92159e-2e", "ovs_interfaceid": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=9d92159e-2ef5-43c8-bb24-9d0f73a875ac,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d92159e-2e') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=9d92159e-2ef5-43c8-bb24-9d0f73a875ac,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d92159e-2e') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '008f4891-3a53-5f22-b530-0573b02a8351', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d92159e-2e, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d92159e-2e, col_values=(('qos', UUID('b8b3c1c6-da40-4d78-87bb-c04af5c99835')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d92159e-2e, col_values=(('external_ids', {'iface-id': '9d92159e-2ef5-43c8-bb24-9d0f73a875ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:04:3c', 'vm-uuid': '8d18f293-ebac-4392-9405-869a7e23f3e0'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: INFO os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=9d92159e-2ef5-43c8-bb24-9d0f73a875ac,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d92159e-2e')
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "address": "fa:16:3e:0d:40:0f", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d4dd71-2d", "ovs_interfaceid": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "address": "fa:16:3e:0d:40:0f", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d4dd71-2d", "ovs_interfaceid": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:40:0f,bridge_name='br-int',has_traffic_filtering=True,id=d8d4dd71-2d05-4d5a-9818-dec95781dd73,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d4dd71-2d') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:40:0f,bridge_name='br-int',has_traffic_filtering=True,id=d8d4dd71-2d05-4d5a-9818-dec95781dd73,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d4dd71-2d') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69a30a06-4ff8-5a05-8ce9-9b8ec53ca2b6', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8d4dd71-2d, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8d4dd71-2d, col_values=(('qos', UUID('35fec0a1-b750-4625-a80d-b44b1cd4f1bf')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8d4dd71-2d, col_values=(('external_ids', {'iface-id': 'd8d4dd71-2d05-4d5a-9818-dec95781dd73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:40:0f', 'vm-uuid': '8d18f293-ebac-4392-9405-869a7e23f3e0'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f1769d95-897b-4e83-89ba-c486aa086dc1 is timed out.
Oct 26 16:57:47 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Successfully detached device vdb from instance f1769d95-897b-4e83-89ba-c486aa086dc1 from the live domain config.
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlBDdSbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:47 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b77417-fb4e-42b0-ad10-8ffd82e03582]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:57:47 user nova-compute[75113]: No targets found.
Oct 26 16:57:47 user nova-compute[75113]: iSNS:
Oct 26 16:57:47 user nova-compute[75113]: No targets found.
Oct 26 16:57:47 user nova-compute[75113]: STATIC:
Oct 26 16:57:47 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc
Oct 26 16:57:47 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:47 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:47 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac
Oct 26 16:57:47 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:47 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:47 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f
Oct 26 16:57:47 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:47 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:47 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7
Oct 26 16:57:47 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:47 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:47 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08
Oct 26 16:57:47 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:47 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:47 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25
Oct 26 16:57:47 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:47 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:47 user nova-compute[75113]: FIRMWARE:
Oct 26 16:57:47 user nova-compute[75113]: No targets found.
Oct 26 16:57:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:57:47 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:57:47 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: INFO os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:40:0f,bridge_name='br-int',has_traffic_filtering=True,id=d8d4dd71-2d05-4d5a-9818-dec95781dd73,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d4dd71-2d')
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "address": "fa:16:3e:dc:3e:7d", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4355f4f-05", "ovs_interfaceid": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "address": "fa:16:3e:dc:3e:7d", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4355f4f-05", "ovs_interfaceid": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d4355f4f-05b7-4b2e-afe4-af2377a4f4b6,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4355f4f-05') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d4355f4f-05b7-4b2e-afe4-af2377a4f4b6,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4355f4f-05') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a879a1a6-e9bb-583b-9d61-7159cde5d972', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8310b647-84d4-49cc-bb3b-746331af4768]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6807dfe2-dc51-4f69-9076-bdefd154156d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:57:47 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:47 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:47 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:47 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:47 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:57:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:57:47 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:47 user nova-compute[75113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc (non-flash)
Oct 26 16:57:47 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:47 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:47 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:57:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914360a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc'): ({'sde'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Removing single pathed devices sde {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a837743b-84ed-4110-9077-6340f9b8accd]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4355f4f-05, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4355f4f-05, col_values=(('qos', UUID('0e4c0b7e-2040-4b88-99ec-cee5b0499f5b')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4355f4f-05, col_values=(('external_ids', {'iface-id': 'd4355f4f-05b7-4b2e-afe4-af2377a4f4b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:3e:7d', 'vm-uuid': '8d18f293-ebac-4392-9405-869a7e23f3e0'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d65d924-74d9-4e74-af29-f27a80cf0627]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Flushing IO for device /dev/sde {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8036faaf-d8d7-43c7-b35f-c4ffa112e1b0]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:57:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e51564c-78cb-4368-9c28-91d42cdf548d]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:48 user nova-compute[75113]: INFO os_vif [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d4355f4f-05b7-4b2e-afe4-af2377a4f4b6,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4355f4f-05')
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[de154494-3192-434c-91c8-3f6a25372123]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d386fbaf-4f60-4ea7-9016-ed2b2bccd1d9]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc, portal: 172.16.0.220,3260]
Oct 26 16:57:48 user nova-compute[75113]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc, portal: 172.16.0.220,3260] successful.
Oct 26 16:57:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] No BDM found with device name hda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] No VIF found with MAC fa:16:3e:5e:8d:bb, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] No VIF found with MAC fa:16:3e:09:04:3c, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:57:48 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Using config drive
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0876d835-1ab0-4103-9353-6361c87078cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[302f54fb-2365-47c2-a794-8e5b0accc74f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] <== disconnect_volume: return (339ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-c2cb43cf-c789-4b5f-8673-4110689b462d req-92ab630e-dde5-4945-91d7-7c28461b3b86 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-vif-plugged-528921b8-dc12-49ae-844c-26313949e09e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c2cb43cf-c789-4b5f-8673-4110689b462d req-92ab630e-dde5-4945-91d7-7c28461b3b86 service nova] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c2cb43cf-c789-4b5f-8673-4110689b462d req-92ab630e-dde5-4945-91d7-7c28461b3b86 service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c2cb43cf-c789-4b5f-8673-4110689b462d req-92ab630e-dde5-4945-91d7-7c28461b3b86 service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-c2cb43cf-c789-4b5f-8673-4110689b462d req-92ab630e-dde5-4945-91d7-7c28461b3b86 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] No waiting events found dispatching network-vif-plugged-528921b8-dc12-49ae-844c-26313949e09e {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:48 user nova-compute[75113]: WARNING nova.compute.manager [req-c2cb43cf-c789-4b5f-8673-4110689b462d req-92ab630e-dde5-4945-91d7-7c28461b3b86 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received unexpected event network-vif-plugged-528921b8-dc12-49ae-844c-26313949e09e for instance with vm_state active and task_state None.
Oct 26 16:57:48 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Creating config drive at /opt/stack/data/nova/instances/8d18f293-ebac-4392-9405-869a7e23f3e0/disk.config
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8d18f293-ebac-4392-9405-869a7e23f3e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1gie38vw {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8d18f293-ebac-4392-9405-869a7e23f3e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1gie38vw" returned: 0 in 0.058s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:48 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance af957c0b-a655-4b55-974a-70256a760d3c is timed out.
Oct 26 16:57:48 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Successfully detached device sdc from instance af957c0b-a655-4b55-974a-70256a760d3c from the live domain config.
Oct 26 16:57:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjogtuEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:48 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f551d93b-c349-4b2c-afd2-dc32cc391a6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:57:48 user nova-compute[75113]: No targets found.
Oct 26 16:57:48 user nova-compute[75113]: iSNS:
Oct 26 16:57:48 user nova-compute[75113]: No targets found.
Oct 26 16:57:48 user nova-compute[75113]: STATIC:
Oct 26 16:57:48 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac
Oct 26 16:57:48 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:48 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:48 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f
Oct 26 16:57:48 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:48 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:48 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7
Oct 26 16:57:48 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:48 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:48 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08
Oct 26 16:57:48 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:48 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:48 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25
Oct 26 16:57:48 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:57:48 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:57:48 user nova-compute[75113]: FIRMWARE:
Oct 26 16:57:48 user nova-compute[75113]: No targets found.
Oct 26 16:57:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:57:48 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:57:48 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ab5f7b-05bc-4ff0-af4e-8825b1fc5955]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d620092-4ea5-4ff5-aff7-b923b985b0ff]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:57:48 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:48 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:48 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:48 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:57:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:57:48 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:57:48 user nova-compute[75113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 (non-flash)
Oct 26 16:57:48 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:57:48 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:57:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f492c38cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25'): ({'sdf'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Removing single pathed devices sdf {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a9dac8-451a-430e-9ad1-a424a9c5a456]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f0a91d-5789-4f24-b535-605dd514bcde]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Flushing IO for device /dev/sdf {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7a901a-f7b6-48eb-baba-9017020847d4]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[93329c15-c8af-4c87-bdc2-5ef5ec617a3d]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] SCSI volumes sdf have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed6a0da-5269-4198-b6b2-dcae25191b58]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:48 user nova-compute[75113]: DEBUG nova.objects.instance [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lazy-loading 'flavor' on Instance uuid f1769d95-897b-4e83-89ba-c486aa086dc1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-60eb899f-a678-4b7e-823c-5d3a212287f2 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.994s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdc7c37-95a3-4c4b-8cea-bd729c9d561d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25, portal: 172.16.0.220,3260]
Oct 26 16:57:49 user nova-compute[75113]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25, portal: 172.16.0.220,3260] successful.
Oct 26 16:57:49 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c47097b2-9194-4fb6-9752-988cf51bcd25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e25fdf0-e71a-4259-9123-61ddf6e8955e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] <== disconnect_volume: return (354ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG nova.objects.instance [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lazy-loading 'flavor' on Instance uuid af957c0b-a655-4b55-974a-70256a760d3c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-91a7bf55-d375-43a5-9b47-dd827c697da7 tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "af957c0b-a655-4b55-974a-70256a760d3c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.910s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-87ae118f-950d-4696-b2b4-c8da98012845 req-e4dc6b0d-6619-4c9f-ab5e-09ed9d050a2e service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-87ae118f-950d-4696-b2b4-c8da98012845 req-e4dc6b0d-6619-4c9f-ab5e-09ed9d050a2e service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-87ae118f-950d-4696-b2b4-c8da98012845 req-e4dc6b0d-6619-4c9f-ab5e-09ed9d050a2e service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-87ae118f-950d-4696-b2b4-c8da98012845 req-e4dc6b0d-6619-4c9f-ab5e-09ed9d050a2e service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-87ae118f-950d-4696-b2b4-c8da98012845 req-e4dc6b0d-6619-4c9f-ab5e-09ed9d050a2e service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:50 user nova-compute[75113]: WARNING nova.compute.manager [req-87ae118f-950d-4696-b2b4-c8da98012845 req-e4dc6b0d-6619-4c9f-ab5e-09ed9d050a2e service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-5dbfd85e-684a-4c18-b660-7491fea99a4a for instance with vm_state building and task_state spawning.
Oct 26 16:57:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-c959939e-2dfd-4278-8fac-deb99fa4623f req-a431e8b7-96b8-4b3f-a205-2773cf04cdb5 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c959939e-2dfd-4278-8fac-deb99fa4623f req-a431e8b7-96b8-4b3f-a205-2773cf04cdb5 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c959939e-2dfd-4278-8fac-deb99fa4623f req-a431e8b7-96b8-4b3f-a205-2773cf04cdb5 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c959939e-2dfd-4278-8fac-deb99fa4623f req-a431e8b7-96b8-4b3f-a205-2773cf04cdb5 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-c959939e-2dfd-4278-8fac-deb99fa4623f req-a431e8b7-96b8-4b3f-a205-2773cf04cdb5 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:50 user nova-compute[75113]: WARNING nova.compute.manager [req-c959939e-2dfd-4278-8fac-deb99fa4623f req-a431e8b7-96b8-4b3f-a205-2773cf04cdb5 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a for instance with vm_state building and task_state spawning.
Oct 26 16:57:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "af957c0b-a655-4b55-974a-70256a760d3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "af957c0b-a655-4b55-974a-70256a760d3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "af957c0b-a655-4b55-974a-70256a760d3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "af957c0b-a655-4b55-974a-70256a760d3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "af957c0b-a655-4b55-974a-70256a760d3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:51 user nova-compute[75113]: INFO nova.compute.manager [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Terminating instance
Oct 26 16:57:51 user nova-compute[75113]: DEBUG nova.compute.manager [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:57:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-cbcda93e-0b95-41b8-bd28-b20d375981a6 req-2da7fe91-caab-49ac-8a8c-44813592f2e1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-d8d4dd71-2d05-4d5a-9818-dec95781dd73 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cbcda93e-0b95-41b8-bd28-b20d375981a6 req-2da7fe91-caab-49ac-8a8c-44813592f2e1 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cbcda93e-0b95-41b8-bd28-b20d375981a6 req-2da7fe91-caab-49ac-8a8c-44813592f2e1 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cbcda93e-0b95-41b8-bd28-b20d375981a6 req-2da7fe91-caab-49ac-8a8c-44813592f2e1 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-cbcda93e-0b95-41b8-bd28-b20d375981a6 req-2da7fe91-caab-49ac-8a8c-44813592f2e1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-d8d4dd71-2d05-4d5a-9818-dec95781dd73 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:52 user nova-compute[75113]: WARNING nova.compute.manager [req-cbcda93e-0b95-41b8-bd28-b20d375981a6 req-2da7fe91-caab-49ac-8a8c-44813592f2e1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-d8d4dd71-2d05-4d5a-9818-dec95781dd73 for instance with vm_state building and task_state spawning.
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:52 user nova-compute[75113]: WARNING nova.compute.manager [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-5dbfd85e-684a-4c18-b660-7491fea99a4a for instance with vm_state building and task_state spawning.
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-9d92159e-2ef5-43c8-bb24-9d0f73a875ac {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-9d92159e-2ef5-43c8-bb24-9d0f73a875ac {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:52 user nova-compute[75113]: WARNING nova.compute.manager [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-9d92159e-2ef5-43c8-bb24-9d0f73a875ac for instance with vm_state building and task_state spawning.
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-9d92159e-2ef5-43c8-bb24-9d0f73a875ac {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-9d92159e-2ef5-43c8-bb24-9d0f73a875ac {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:52 user nova-compute[75113]: WARNING nova.compute.manager [req-f66431e1-e9c1-458c-a3c6-e254c4d215dd req-75421c95-e0eb-4c04-aca9-c81ec8b4a6c0 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-9d92159e-2ef5-43c8-bb24-9d0f73a875ac for instance with vm_state building and task_state spawning.
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Instance destroyed successfully.
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.objects.instance [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lazy-loading 'resources' on Instance uuid af957c0b-a655-4b55-974a-70256a760d3c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1426482460',display_name='tempest-AttachSCSIVolumeTestJSON-server-1426482460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1426482460',id=5,image_ref='cc1f1336-ef01-47e1-90f2-25afaf721b82',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0K28/2i+M3UmaIYAKYzesmqLzym/PUmV55xe9Lo8DFBRg1Pe6l5b8hBe4JpEyk1G2LHOlJXiXSZ8FGlfp45/x8bNO+s/pXJcZaHArKZia52ZX1WbUya0RUqlrQpLjyXA==',key_name='tempest-keypair-1204517582',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17a0645348045aa82d80f7291a44d3c',ramdisk_id='',reservation_id='r-p2e7dfma',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cc1f1336-ef01-47e1-90f2-25afaf721b82',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-372264898',owner_user_name='tempest-AttachSCSIVolumeTestJSON-372264898-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:54:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1e946a8fbdc4a03b4ea92a6625eaf76',uuid=af957c0b-a655-4b55-974a-70256a760d3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "address": "fa:16:3e:8a:91:a9", "network": {"id": "c18bc66f-1d7e-41b4-b583-fce9e5d78cd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1141220283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17a0645348045aa82d80f7291a44d3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39dbc0a5-bf", "ovs_interfaceid": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Converting VIF {"id": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "address": "fa:16:3e:8a:91:a9", "network": {"id": "c18bc66f-1d7e-41b4-b583-fce9e5d78cd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1141220283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17a0645348045aa82d80f7291a44d3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39dbc0a5-bf", "ovs_interfaceid": "39dbc0a5-bfeb-47fc-993b-06de27422f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:91:a9,bridge_name='br-int',has_traffic_filtering=True,id=39dbc0a5-bfeb-47fc-993b-06de27422f03,network=Network(c18bc66f-1d7e-41b4-b583-fce9e5d78cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39dbc0a5-bf') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG os_vif [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:91:a9,bridge_name='br-int',has_traffic_filtering=True,id=39dbc0a5-bfeb-47fc-993b-06de27422f03,network=Network(c18bc66f-1d7e-41b4-b583-fce9e5d78cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39dbc0a5-bf') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:52 user nova-compute[75113]: WARNING nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a for instance with vm_state building and task_state spawning.
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-c46d4142-9e17-4a68-904c-f0ae8102ecc8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-c46d4142-9e17-4a68-904c-f0ae8102ecc8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:52 user nova-compute[75113]: WARNING nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-c46d4142-9e17-4a68-904c-f0ae8102ecc8 for instance with vm_state building and task_state spawning.
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-c46d4142-9e17-4a68-904c-f0ae8102ecc8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-c46d4142-9e17-4a68-904c-f0ae8102ecc8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:52 user nova-compute[75113]: WARNING nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-c46d4142-9e17-4a68-904c-f0ae8102ecc8 for instance with vm_state building and task_state spawning.
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:52 user nova-compute[75113]: WARNING nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 for instance with vm_state building and task_state spawning.
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:52 user nova-compute[75113]: WARNING nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 for instance with vm_state building and task_state spawning.
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Received event network-vif-unplugged-39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Acquiring lock "af957c0b-a655-4b55-974a-70256a760d3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Lock "af957c0b-a655-4b55-974a-70256a760d3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] Lock "af957c0b-a655-4b55-974a-70256a760d3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] No waiting events found dispatching network-vif-unplugged-39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8346a52-815b-4020-bf5f-e12c2de8c877 req-89340e5b-7e9d-4d0d-8eb7-11fca4451550 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Received event network-vif-unplugged-39dbc0a5-bfeb-47fc-993b-06de27422f03 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39dbc0a5-bf, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6187da6-f4af-4c76-93cf-86384cf6d47d) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:52 user nova-compute[75113]: INFO os_vif [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:91:a9,bridge_name='br-int',has_traffic_filtering=True,id=39dbc0a5-bfeb-47fc-993b-06de27422f03,network=Network(c18bc66f-1d7e-41b4-b583-fce9e5d78cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39dbc0a5-bf')
Oct 26 16:57:52 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Deleting instance files /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c_del
Oct 26 16:57:52 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Deletion of /opt/stack/data/nova/instances/af957c0b-a655-4b55-974a-70256a760d3c_del complete
Oct 26 16:57:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:53 user nova-compute[75113]: INFO nova.compute.manager [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Took 1.45 seconds to destroy the instance on the hypervisor.
Oct 26 16:57:53 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: af957c0b-a655-4b55-974a-70256a760d3c] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "69ed2396-a603-4c84-a66b-7b474523b68e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG nova.objects.instance [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lazy-loading 'flavor' on Instance uuid 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "69ed2396-a603-4c84-a66b-7b474523b68e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "69ed2396-a603-4c84-a66b-7b474523b68e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:54 user nova-compute[75113]: INFO nova.compute.manager [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Attaching volume 80806a8c-ae83-411e-b575-f4ccb122db00 to /dev/vdb
Oct 26 16:57:54 user nova-compute[75113]: DEBUG os_brick.utils [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce23a227-6576-40f4-9670-3d0e37105c16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[803ea4a9-12b8-4914-9483-70e5cef3387c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:54 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Took 1.13 seconds to deallocate network for instance.
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d2c13e-ee52-44c1-b7cb-dee2a8bef36c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba41972-a464-4279-82f5-6ca5f6fbcae3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:57:54 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3e16c2-2350-4a77-b02c-1ecc76a1b3e5]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG os_brick.utils [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updating existing volume attachment record: b3ce3389-f27c-44c8-bf61-3f7e701a7006 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-c4e70259-962e-4dd2-a843-07626b421240 req-c7e69f01-287b-403c-b60c-da9b89019bab service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-d8d4dd71-2d05-4d5a-9818-dec95781dd73 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c4e70259-962e-4dd2-a843-07626b421240 req-c7e69f01-287b-403c-b60c-da9b89019bab service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c4e70259-962e-4dd2-a843-07626b421240 req-c7e69f01-287b-403c-b60c-da9b89019bab service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c4e70259-962e-4dd2-a843-07626b421240 req-c7e69f01-287b-403c-b60c-da9b89019bab service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-c4e70259-962e-4dd2-a843-07626b421240 req-c7e69f01-287b-403c-b60c-da9b89019bab service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-d8d4dd71-2d05-4d5a-9818-dec95781dd73 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:54 user nova-compute[75113]: WARNING nova.compute.manager [req-c4e70259-962e-4dd2-a843-07626b421240 req-c7e69f01-287b-403c-b60c-da9b89019bab service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-d8d4dd71-2d05-4d5a-9818-dec95781dd73 for instance with vm_state building and task_state spawning.
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-2b680c7e-64d3-4da6-b849-7bd99501e464 req-49f9c684-fe9b-4c91-ba56-4ae2650b9877 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b680c7e-64d3-4da6-b849-7bd99501e464 req-49f9c684-fe9b-4c91-ba56-4ae2650b9877 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b680c7e-64d3-4da6-b849-7bd99501e464 req-49f9c684-fe9b-4c91-ba56-4ae2650b9877 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b680c7e-64d3-4da6-b849-7bd99501e464 req-49f9c684-fe9b-4c91-ba56-4ae2650b9877 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-2b680c7e-64d3-4da6-b849-7bd99501e464 req-49f9c684-fe9b-4c91-ba56-4ae2650b9877 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:54 user nova-compute[75113]: WARNING nova.compute.manager [req-2b680c7e-64d3-4da6-b849-7bd99501e464 req-49f9c684-fe9b-4c91-ba56-4ae2650b9877 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 for instance with vm_state building and task_state spawning.
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-2b680c7e-64d3-4da6-b849-7bd99501e464 req-49f9c684-fe9b-4c91-ba56-4ae2650b9877 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b680c7e-64d3-4da6-b849-7bd99501e464 req-49f9c684-fe9b-4c91-ba56-4ae2650b9877 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b680c7e-64d3-4da6-b849-7bd99501e464 req-49f9c684-fe9b-4c91-ba56-4ae2650b9877 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b680c7e-64d3-4da6-b849-7bd99501e464 req-49f9c684-fe9b-4c91-ba56-4ae2650b9877 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-2b680c7e-64d3-4da6-b849-7bd99501e464 req-49f9c684-fe9b-4c91-ba56-4ae2650b9877 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:54 user nova-compute[75113]: WARNING nova.compute.manager [req-2b680c7e-64d3-4da6-b849-7bd99501e464 req-49f9c684-fe9b-4c91-ba56-4ae2650b9877 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 for instance with vm_state building and task_state spawning.
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-2b680c7e-64d3-4da6-b849-7bd99501e464 req-49f9c684-fe9b-4c91-ba56-4ae2650b9877 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Received event network-vif-deleted-39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.561s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-2a68ca42-9356-446f-83a4-86227f16f989 req-0781c7b2-4e20-4792-9135-3b5eb6a9c012 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Received event network-vif-plugged-39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2a68ca42-9356-446f-83a4-86227f16f989 req-0781c7b2-4e20-4792-9135-3b5eb6a9c012 service nova] Acquiring lock "af957c0b-a655-4b55-974a-70256a760d3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2a68ca42-9356-446f-83a4-86227f16f989 req-0781c7b2-4e20-4792-9135-3b5eb6a9c012 service nova] Lock "af957c0b-a655-4b55-974a-70256a760d3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2a68ca42-9356-446f-83a4-86227f16f989 req-0781c7b2-4e20-4792-9135-3b5eb6a9c012 service nova] Lock "af957c0b-a655-4b55-974a-70256a760d3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-2a68ca42-9356-446f-83a4-86227f16f989 req-0781c7b2-4e20-4792-9135-3b5eb6a9c012 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] No waiting events found dispatching network-vif-plugged-39dbc0a5-bfeb-47fc-993b-06de27422f03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:57:54 user nova-compute[75113]: WARNING nova.compute.manager [req-2a68ca42-9356-446f-83a4-86227f16f989 req-0781c7b2-4e20-4792-9135-3b5eb6a9c012 service nova] [instance: af957c0b-a655-4b55-974a-70256a760d3c] Received unexpected event network-vif-plugged-39dbc0a5-bfeb-47fc-993b-06de27422f03 for instance with vm_state deleted and task_state None.
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:57:54 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Deleted allocations for instance af957c0b-a655-4b55-974a-70256a760d3c
Oct 26 16:57:54 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Instance spawned successfully.
Oct 26 16:57:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:57:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:57:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:57:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:57:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:57:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:57:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:57:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-507f5735-eda7-4650-ac29-6ef07517d68f tempest-AttachSCSIVolumeTestJSON-372264898 tempest-AttachSCSIVolumeTestJSON-372264898-project-member] Lock "af957c0b-a655-4b55-974a-70256a760d3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.549s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:55 user nova-compute[75113]: INFO nova.compute.manager [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Took 13.03 seconds to spawn the instance on the hypervisor.
Oct 26 16:57:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:57:55 user nova-compute[75113]: INFO nova.compute.manager [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Took 126.48 seconds to build instance.
Oct 26 16:57:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dbd0afdc-defd-4b90-9706-88e1362e454c tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 126.629s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:56 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:57:56 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:57:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-f1769d95-897b-4e83-89ba-c486aa086dc1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:57:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-f1769d95-897b-4e83-89ba-c486aa086dc1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:57:56 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:57:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:56 user nova-compute[75113]: DEBUG nova.objects.instance [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lazy-loading 'flavor' on Instance uuid 645deae0-4c03-41d0-aa3b-daa79ed25425 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:57:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:56 user nova-compute[75113]: INFO nova.compute.manager [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Attaching volume d2af05ff-ba68-4321-b9b9-b5cf9a720bad to /dev/vdb
Oct 26 16:57:57 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Updating instance_info_cache with network_info: [{"id": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "address": "fa:16:3e:54:a8:27", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af075bf-d8", "ovs_interfaceid": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-f1769d95-897b-4e83-89ba-c486aa086dc1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG os_brick.utils [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2ceda5-e814-48fe-9a46-3eec6adb5739]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[164cefbd-d2c3-4b22-a855-b542da38f84a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[419c9f98-51d1-459e-b774-8c751ea36b39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6238ecd-d87b-42cb-b252-13f87b91523e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:57:57 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3348fd-ae0e-4a46-96c2-0d2dbbca5e5e]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG os_brick.utils [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating existing volume attachment record: c10ca807-5128-423f-ad58-3765cb44ea16 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:57:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:57:58 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:57:58 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:57:58 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:57:58 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:57:59 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:57:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:57:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:57:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:57:59 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:57:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:57:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:57:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:58:03 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:58:03 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7709MB free_disk=25.424991607666016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 645deae0-4c03-41d0-aa3b-daa79ed25425 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 69ed2396-a603-4c84-a66b-7b474523b68e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance f1769d95-897b-4e83-89ba-c486aa086dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fbf1e605-91c5-4188-9081-f9762ad92a9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e632e8ad-6d44-4a57-a04b-342bdf513260 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9064edf2-de11-4223-baed-d346bfe34fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance a8368686-8c4d-4373-a3a5-4498e2086e0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 8d18f293-ebac-4392-9405-869a7e23f3e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance cafa9881-242a-4275-8125-80f415d56ee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:58:03 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:58:04 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:58:04 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:58:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:58:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:06 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Waiting for libvirt event about the detach of device tap528921b8-dc with device alias net1 from instance 9064edf2-de11-4223-baed-d346bfe34fcc is timed out.
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:79:25:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tap528921b8-dc"/></interface> {{(pid=75113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:79:25:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tap528921b8-dc"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 26 16:58:06 user nova-compute[75113]:   <name>instance-00000008</name>
Oct 26 16:58:06 user nova-compute[75113]:   <uuid>9064edf2-de11-4223-baed-d346bfe34fcc</uuid>
Oct 26 16:58:06 user nova-compute[75113]:   <metadata>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:58:06 user nova-compute[75113]:   <nova:package version="0.0.0"/>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:name>tempest-device-tagging-server-1384773775</nova:name>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:creationTime>2023-10-26 16:56:36</nova:creationTime>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:flavor name="m1.tiny">
Oct 26 16:58:06 user nova-compute[75113]:     <nova:memory>512</nova:memory>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:disk>1</nova:disk>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:swap>0</nova:swap>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:vcpus>1</nova:vcpus>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:flavor>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:owner>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:user uuid="c3b34c772fc54da89ff6787f12fef797">tempest-TaggedAttachmentsTest-508694228-project-member</nova:user>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:project uuid="87c7a88071a24c96abb06407c59a2775">tempest-TaggedAttachmentsTest-508694228</nova:project>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:owner>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:ports>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:port uuid="b55efe74-8efe-4e0d-a917-a9c47cae9a85">
Oct 26 16:58:06 user nova-compute[75113]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 16:58:06 user nova-compute[75113]:     </nova:port>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:port uuid="528921b8-dc12-49ae-844c-26313949e09e">
Oct 26 16:58:06 user nova-compute[75113]:       <nova:ip type="fixed" address="10.10.10.18" ipVersion="4"/>
Oct 26 16:58:06 user nova-compute[75113]:     </nova:port>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:ports>
Oct 26 16:58:06 user nova-compute[75113]: </nova:instance>
Oct 26 16:58:06 user nova-compute[75113]:   </metadata>
Oct 26 16:58:06 user nova-compute[75113]:   <memory unit='KiB'>524288</memory>
Oct 26 16:58:06 user nova-compute[75113]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 16:58:06 user nova-compute[75113]:   <vcpu placement='static'>1</vcpu>
Oct 26 16:58:06 user nova-compute[75113]:   <resource>
Oct 26 16:58:06 user nova-compute[75113]:     <partition>/machine</partition>
Oct 26 16:58:06 user nova-compute[75113]:   </resource>
Oct 26 16:58:06 user nova-compute[75113]:   <sysinfo type='smbios'>
Oct 26 16:58:06 user nova-compute[75113]:     <system>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='version'>0.0.0</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='serial'>9064edf2-de11-4223-baed-d346bfe34fcc</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='uuid'>9064edf2-de11-4223-baed-d346bfe34fcc</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='family'>Virtual Machine</entry>
Oct 26 16:58:06 user nova-compute[75113]:     </system>
Oct 26 16:58:06 user nova-compute[75113]:   </sysinfo>
Oct 26 16:58:06 user nova-compute[75113]:   <os>
Oct 26 16:58:06 user nova-compute[75113]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 16:58:06 user nova-compute[75113]:     <boot dev='hd'/>
Oct 26 16:58:06 user nova-compute[75113]:     <smbios mode='sysinfo'/>
Oct 26 16:58:06 user nova-compute[75113]:   </os>
Oct 26 16:58:06 user nova-compute[75113]:   <features>
Oct 26 16:58:06 user nova-compute[75113]:     <acpi/>
Oct 26 16:58:06 user nova-compute[75113]:     <apic/>
Oct 26 16:58:06 user nova-compute[75113]:     <vmcoreinfo state='on'/>
Oct 26 16:58:06 user nova-compute[75113]:   </features>
Oct 26 16:58:06 user nova-compute[75113]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 16:58:06 user nova-compute[75113]:     <model fallback='forbid'>Nehalem</model>
Oct 26 16:58:06 user nova-compute[75113]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 16:58:06 user nova-compute[75113]:     <feature policy='require' name='vme'/>
Oct 26 16:58:06 user nova-compute[75113]:     <feature policy='require' name='x2apic'/>
Oct 26 16:58:06 user nova-compute[75113]:     <feature policy='require' name='hypervisor'/>
Oct 26 16:58:06 user nova-compute[75113]:   </cpu>
Oct 26 16:58:06 user nova-compute[75113]:   <clock offset='utc'>
Oct 26 16:58:06 user nova-compute[75113]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 16:58:06 user nova-compute[75113]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 16:58:06 user nova-compute[75113]:     <timer name='hpet' present='no'/>
Oct 26 16:58:06 user nova-compute[75113]:   </clock>
Oct 26 16:58:06 user nova-compute[75113]:   <on_poweroff>destroy</on_poweroff>
Oct 26 16:58:06 user nova-compute[75113]:   <on_reboot>restart</on_reboot>
Oct 26 16:58:06 user nova-compute[75113]:   <on_crash>destroy</on_crash>
Oct 26 16:58:06 user nova-compute[75113]:   <devices>
Oct 26 16:58:06 user nova-compute[75113]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 16:58:06 user nova-compute[75113]:     <disk type='file' device='disk'>
Oct 26 16:58:06 user nova-compute[75113]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 16:58:06 user nova-compute[75113]:       <source file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk' index='2'/>
Oct 26 16:58:06 user nova-compute[75113]:       <backingStore type='file' index='3'>
Oct 26 16:58:06 user nova-compute[75113]:         <format type='raw'/>
Oct 26 16:58:06 user nova-compute[75113]:         <source file='/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0'/>
Oct 26 16:58:06 user nova-compute[75113]:         <backingStore/>
Oct 26 16:58:06 user nova-compute[75113]:       </backingStore>
Oct 26 16:58:06 user nova-compute[75113]:       <target dev='vda' bus='virtio'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='virtio-disk0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </disk>
Oct 26 16:58:06 user nova-compute[75113]:     <disk type='file' device='cdrom'>
Oct 26 16:58:06 user nova-compute[75113]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 16:58:06 user nova-compute[75113]:       <source file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk.config' index='1'/>
Oct 26 16:58:06 user nova-compute[75113]:       <backingStore/>
Oct 26 16:58:06 user nova-compute[75113]:       <target dev='hda' bus='ide'/>
Oct 26 16:58:06 user nova-compute[75113]:       <readonly/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='ide0-0-0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </disk>
Oct 26 16:58:06 user nova-compute[75113]:     <controller type='usb' index='0' model='none'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='usb'/>
Oct 26 16:58:06 user nova-compute[75113]:     </controller>
Oct 26 16:58:06 user nova-compute[75113]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='pci.0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </controller>
Oct 26 16:58:06 user nova-compute[75113]:     <controller type='ide' index='0'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='ide'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 16:58:06 user nova-compute[75113]:     </controller>
Oct 26 16:58:06 user nova-compute[75113]:     <interface type='ethernet'>
Oct 26 16:58:06 user nova-compute[75113]:       <mac address='fa:16:3e:84:a4:ac'/>
Oct 26 16:58:06 user nova-compute[75113]:       <target dev='tapb55efe74-8e'/>
Oct 26 16:58:06 user nova-compute[75113]:       <model type='virtio'/>
Oct 26 16:58:06 user nova-compute[75113]:       <mtu size='1442'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='net0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </interface>
Oct 26 16:58:06 user nova-compute[75113]:     <serial type='pty'>
Oct 26 16:58:06 user nova-compute[75113]:       <source path='/dev/pts/7'/>
Oct 26 16:58:06 user nova-compute[75113]:       <log file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/console.log' append='off'/>
Oct 26 16:58:06 user nova-compute[75113]:       <target type='isa-serial' port='0'>
Oct 26 16:58:06 user nova-compute[75113]:         <model name='isa-serial'/>
Oct 26 16:58:06 user nova-compute[75113]:       </target>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='serial0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </serial>
Oct 26 16:58:06 user nova-compute[75113]:     <console type='pty' tty='/dev/pts/7'>
Oct 26 16:58:06 user nova-compute[75113]:       <source path='/dev/pts/7'/>
Oct 26 16:58:06 user nova-compute[75113]:       <log file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/console.log' append='off'/>
Oct 26 16:58:06 user nova-compute[75113]:       <target type='serial' port='0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='serial0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </console>
Oct 26 16:58:06 user nova-compute[75113]:     <input type='mouse' bus='ps2'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='input0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </input>
Oct 26 16:58:06 user nova-compute[75113]:     <input type='keyboard' bus='ps2'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='input1'/>
Oct 26 16:58:06 user nova-compute[75113]:     </input>
Oct 26 16:58:06 user nova-compute[75113]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 26 16:58:06 user nova-compute[75113]:       <listen type='address' address='0.0.0.0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </graphics>
Oct 26 16:58:06 user nova-compute[75113]:     <audio id='1' type='none'/>
Oct 26 16:58:06 user nova-compute[75113]:     <video>
Oct 26 16:58:06 user nova-compute[75113]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='video0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </video>
Oct 26 16:58:06 user nova-compute[75113]:     <memballoon model='virtio'>
Oct 26 16:58:06 user nova-compute[75113]:       <stats period='10'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='balloon0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </memballoon>
Oct 26 16:58:06 user nova-compute[75113]:     <rng model='virtio'>
Oct 26 16:58:06 user nova-compute[75113]:       <backend model='random'>/dev/urandom</backend>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='rng0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </rng>
Oct 26 16:58:06 user nova-compute[75113]:   </devices>
Oct 26 16:58:06 user nova-compute[75113]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 16:58:06 user nova-compute[75113]:     <label>libvirt-9064edf2-de11-4223-baed-d346bfe34fcc</label>
Oct 26 16:58:06 user nova-compute[75113]:     <imagelabel>libvirt-9064edf2-de11-4223-baed-d346bfe34fcc</imagelabel>
Oct 26 16:58:06 user nova-compute[75113]:   </seclabel>
Oct 26 16:58:06 user nova-compute[75113]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 16:58:06 user nova-compute[75113]:     <label>+64055:+108</label>
Oct 26 16:58:06 user nova-compute[75113]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 16:58:06 user nova-compute[75113]:   </seclabel>
Oct 26 16:58:06 user nova-compute[75113]: </domain>
Oct 26 16:58:06 user nova-compute[75113]:  {{(pid=75113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 16:58:06 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Successfully detached device tap528921b8-dc from instance 9064edf2-de11-4223-baed-d346bfe34fcc from the live domain config.
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1384773775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1384773775',id=8,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESp5K/14Ggl6vrqYPJZwPerrbYDesNlYVE2P8OiIAmeuCFyfagPIf0wDUE44PKomsOLEBGK5zvmXNCoV246gjfXa+oGWMEfMNs4yKfAzQiMGQTrxjH+/YVUO6sO4X+6vw==',key_name='tempest-keypair-1710846497',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87c7a88071a24c96abb06407c59a2775',ramdisk_id='',reservation_id='r-0pxw2si0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-508694228',owner_user_name='tempest-TaggedAttachmentsTest-508694228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3b34c772fc54da89ff6787f12fef797',uuid=9064edf2-de11-4223-baed-d346bfe34fcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converting VIF {"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:25:b9,bridge_name='br-int',has_traffic_filtering=True,id=528921b8-dc12-49ae-844c-26313949e09e,network=Network(891dc6b2-cbc0-4f37-b84b-0e618790a183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528921b8-dc') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG os_vif [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:25:b9,bridge_name='br-int',has_traffic_filtering=True,id=528921b8-dc12-49ae-844c-26313949e09e,network=Network(891dc6b2-cbc0-4f37-b84b-0e618790a183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528921b8-dc') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap528921b8-dc, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4ebc7a1-c026-4411-8ee6-48c5b85c6288) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:06 user nova-compute[75113]: INFO os_vif [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:25:b9,bridge_name='br-int',has_traffic_filtering=True,id=528921b8-dc12-49ae-844c-26313949e09e,network=Network(891dc6b2-cbc0-4f37-b84b-0e618790a183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528921b8-dc')
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:58:06 user nova-compute[75113]:   <nova:package version="0.0.0"/>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:name>tempest-device-tagging-server-1384773775</nova:name>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:creationTime>2023-10-26 16:58:06</nova:creationTime>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:flavor name="m1.tiny">
Oct 26 16:58:06 user nova-compute[75113]:     <nova:memory>512</nova:memory>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:disk>1</nova:disk>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:swap>0</nova:swap>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:vcpus>1</nova:vcpus>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:flavor>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:owner>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:user uuid="c3b34c772fc54da89ff6787f12fef797">tempest-TaggedAttachmentsTest-508694228-project-member</nova:user>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:project uuid="87c7a88071a24c96abb06407c59a2775">tempest-TaggedAttachmentsTest-508694228</nova:project>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:owner>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:ports>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:port uuid="b55efe74-8efe-4e0d-a917-a9c47cae9a85">
Oct 26 16:58:06 user nova-compute[75113]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 16:58:06 user nova-compute[75113]:     </nova:port>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:ports>
Oct 26 16:58:06 user nova-compute[75113]: </nova:instance>
Oct 26 16:58:06 user nova-compute[75113]:  {{(pid=75113) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-vif-deleted-528921b8-dc12-49ae-844c-26313949e09e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:06 user nova-compute[75113]: INFO nova.compute.manager [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Neutron deleted interface 528921b8-dc12-49ae-844c-26313949e09e; detaching it from the instance and deleting it from the info cache
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.network.neutron [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Updating instance_info_cache with network_info: [{"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.objects.instance [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] Lazy-loading 'system_metadata' on Instance uuid 9064edf2-de11-4223-baed-d346bfe34fcc {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquired lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.network.neutron [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.objects.instance [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] Lazy-loading 'flavor' on Instance uuid 9064edf2-de11-4223-baed-d346bfe34fcc {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.objects.base [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] Object Instance<9064edf2-de11-4223-baed-d346bfe34fcc> lazy-loaded attributes: system_metadata,flavor {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1384773775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1384773775',id=8,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESp5K/14Ggl6vrqYPJZwPerrbYDesNlYVE2P8OiIAmeuCFyfagPIf0wDUE44PKomsOLEBGK5zvmXNCoV246gjfXa+oGWMEfMNs4yKfAzQiMGQTrxjH+/YVUO6sO4X+6vw==',key_name='tempest-keypair-1710846497',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87c7a88071a24c96abb06407c59a2775',ramdisk_id='',reservation_id='r-0pxw2si0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-508694228',owner_user_name='tempest-TaggedAttachmentsTest-508694228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3b34c772fc54da89ff6787f12fef797',uuid=9064edf2-de11-4223-baed-d346bfe34fcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.network.os_vif_util [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] Converting VIF {"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.network.os_vif_util [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:25:b9,bridge_name='br-int',has_traffic_filtering=True,id=528921b8-dc12-49ae-844c-26313949e09e,network=Network(891dc6b2-cbc0-4f37-b84b-0e618790a183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528921b8-dc') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:79:25:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tap528921b8-dc"/></interface> {{(pid=75113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:79:25:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tap528921b8-dc"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 26 16:58:06 user nova-compute[75113]:   <name>instance-00000008</name>
Oct 26 16:58:06 user nova-compute[75113]:   <uuid>9064edf2-de11-4223-baed-d346bfe34fcc</uuid>
Oct 26 16:58:06 user nova-compute[75113]:   <metadata>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:58:06 user nova-compute[75113]:   <nova:package version="0.0.0"/>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:name>tempest-device-tagging-server-1384773775</nova:name>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:creationTime>2023-10-26 16:58:06</nova:creationTime>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:flavor name="m1.tiny">
Oct 26 16:58:06 user nova-compute[75113]:     <nova:memory>512</nova:memory>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:disk>1</nova:disk>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:swap>0</nova:swap>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:vcpus>1</nova:vcpus>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:flavor>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:owner>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:user uuid="c3b34c772fc54da89ff6787f12fef797">tempest-TaggedAttachmentsTest-508694228-project-member</nova:user>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:project uuid="87c7a88071a24c96abb06407c59a2775">tempest-TaggedAttachmentsTest-508694228</nova:project>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:owner>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:ports>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:port uuid="b55efe74-8efe-4e0d-a917-a9c47cae9a85">
Oct 26 16:58:06 user nova-compute[75113]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 16:58:06 user nova-compute[75113]:     </nova:port>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:ports>
Oct 26 16:58:06 user nova-compute[75113]: </nova:instance>
Oct 26 16:58:06 user nova-compute[75113]:   </metadata>
Oct 26 16:58:06 user nova-compute[75113]:   <memory unit='KiB'>524288</memory>
Oct 26 16:58:06 user nova-compute[75113]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 16:58:06 user nova-compute[75113]:   <vcpu placement='static'>1</vcpu>
Oct 26 16:58:06 user nova-compute[75113]:   <resource>
Oct 26 16:58:06 user nova-compute[75113]:     <partition>/machine</partition>
Oct 26 16:58:06 user nova-compute[75113]:   </resource>
Oct 26 16:58:06 user nova-compute[75113]:   <sysinfo type='smbios'>
Oct 26 16:58:06 user nova-compute[75113]:     <system>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='version'>0.0.0</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='serial'>9064edf2-de11-4223-baed-d346bfe34fcc</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='uuid'>9064edf2-de11-4223-baed-d346bfe34fcc</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='family'>Virtual Machine</entry>
Oct 26 16:58:06 user nova-compute[75113]:     </system>
Oct 26 16:58:06 user nova-compute[75113]:   </sysinfo>
Oct 26 16:58:06 user nova-compute[75113]:   <os>
Oct 26 16:58:06 user nova-compute[75113]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 16:58:06 user nova-compute[75113]:     <boot dev='hd'/>
Oct 26 16:58:06 user nova-compute[75113]:     <smbios mode='sysinfo'/>
Oct 26 16:58:06 user nova-compute[75113]:   </os>
Oct 26 16:58:06 user nova-compute[75113]:   <features>
Oct 26 16:58:06 user nova-compute[75113]:     <acpi/>
Oct 26 16:58:06 user nova-compute[75113]:     <apic/>
Oct 26 16:58:06 user nova-compute[75113]:     <vmcoreinfo state='on'/>
Oct 26 16:58:06 user nova-compute[75113]:   </features>
Oct 26 16:58:06 user nova-compute[75113]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 16:58:06 user nova-compute[75113]:     <model fallback='forbid'>Nehalem</model>
Oct 26 16:58:06 user nova-compute[75113]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 16:58:06 user nova-compute[75113]:     <feature policy='require' name='vme'/>
Oct 26 16:58:06 user nova-compute[75113]:     <feature policy='require' name='x2apic'/>
Oct 26 16:58:06 user nova-compute[75113]:     <feature policy='require' name='hypervisor'/>
Oct 26 16:58:06 user nova-compute[75113]:   </cpu>
Oct 26 16:58:06 user nova-compute[75113]:   <clock offset='utc'>
Oct 26 16:58:06 user nova-compute[75113]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 16:58:06 user nova-compute[75113]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 16:58:06 user nova-compute[75113]:     <timer name='hpet' present='no'/>
Oct 26 16:58:06 user nova-compute[75113]:   </clock>
Oct 26 16:58:06 user nova-compute[75113]:   <on_poweroff>destroy</on_poweroff>
Oct 26 16:58:06 user nova-compute[75113]:   <on_reboot>restart</on_reboot>
Oct 26 16:58:06 user nova-compute[75113]:   <on_crash>destroy</on_crash>
Oct 26 16:58:06 user nova-compute[75113]:   <devices>
Oct 26 16:58:06 user nova-compute[75113]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 16:58:06 user nova-compute[75113]:     <disk type='file' device='disk'>
Oct 26 16:58:06 user nova-compute[75113]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 16:58:06 user nova-compute[75113]:       <source file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk' index='2'/>
Oct 26 16:58:06 user nova-compute[75113]:       <backingStore type='file' index='3'>
Oct 26 16:58:06 user nova-compute[75113]:         <format type='raw'/>
Oct 26 16:58:06 user nova-compute[75113]:         <source file='/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0'/>
Oct 26 16:58:06 user nova-compute[75113]:         <backingStore/>
Oct 26 16:58:06 user nova-compute[75113]:       </backingStore>
Oct 26 16:58:06 user nova-compute[75113]:       <target dev='vda' bus='virtio'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='virtio-disk0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </disk>
Oct 26 16:58:06 user nova-compute[75113]:     <disk type='file' device='cdrom'>
Oct 26 16:58:06 user nova-compute[75113]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 16:58:06 user nova-compute[75113]:       <source file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk.config' index='1'/>
Oct 26 16:58:06 user nova-compute[75113]:       <backingStore/>
Oct 26 16:58:06 user nova-compute[75113]:       <target dev='hda' bus='ide'/>
Oct 26 16:58:06 user nova-compute[75113]:       <readonly/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='ide0-0-0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </disk>
Oct 26 16:58:06 user nova-compute[75113]:     <controller type='usb' index='0' model='none'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='usb'/>
Oct 26 16:58:06 user nova-compute[75113]:     </controller>
Oct 26 16:58:06 user nova-compute[75113]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='pci.0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </controller>
Oct 26 16:58:06 user nova-compute[75113]:     <controller type='ide' index='0'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='ide'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 16:58:06 user nova-compute[75113]:     </controller>
Oct 26 16:58:06 user nova-compute[75113]:     <interface type='ethernet'>
Oct 26 16:58:06 user nova-compute[75113]:       <mac address='fa:16:3e:84:a4:ac'/>
Oct 26 16:58:06 user nova-compute[75113]:       <target dev='tapb55efe74-8e'/>
Oct 26 16:58:06 user nova-compute[75113]:       <model type='virtio'/>
Oct 26 16:58:06 user nova-compute[75113]:       <mtu size='1442'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='net0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </interface>
Oct 26 16:58:06 user nova-compute[75113]:     <serial type='pty'>
Oct 26 16:58:06 user nova-compute[75113]:       <source path='/dev/pts/7'/>
Oct 26 16:58:06 user nova-compute[75113]:       <log file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/console.log' append='off'/>
Oct 26 16:58:06 user nova-compute[75113]:       <target type='isa-serial' port='0'>
Oct 26 16:58:06 user nova-compute[75113]:         <model name='isa-serial'/>
Oct 26 16:58:06 user nova-compute[75113]:       </target>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='serial0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </serial>
Oct 26 16:58:06 user nova-compute[75113]:     <console type='pty' tty='/dev/pts/7'>
Oct 26 16:58:06 user nova-compute[75113]:       <source path='/dev/pts/7'/>
Oct 26 16:58:06 user nova-compute[75113]:       <log file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/console.log' append='off'/>
Oct 26 16:58:06 user nova-compute[75113]:       <target type='serial' port='0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='serial0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </console>
Oct 26 16:58:06 user nova-compute[75113]:     <input type='mouse' bus='ps2'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='input0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </input>
Oct 26 16:58:06 user nova-compute[75113]:     <input type='keyboard' bus='ps2'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='input1'/>
Oct 26 16:58:06 user nova-compute[75113]:     </input>
Oct 26 16:58:06 user nova-compute[75113]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 26 16:58:06 user nova-compute[75113]:       <listen type='address' address='0.0.0.0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </graphics>
Oct 26 16:58:06 user nova-compute[75113]:     <audio id='1' type='none'/>
Oct 26 16:58:06 user nova-compute[75113]:     <video>
Oct 26 16:58:06 user nova-compute[75113]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='video0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </video>
Oct 26 16:58:06 user nova-compute[75113]:     <memballoon model='virtio'>
Oct 26 16:58:06 user nova-compute[75113]:       <stats period='10'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='balloon0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </memballoon>
Oct 26 16:58:06 user nova-compute[75113]:     <rng model='virtio'>
Oct 26 16:58:06 user nova-compute[75113]:       <backend model='random'>/dev/urandom</backend>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='rng0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </rng>
Oct 26 16:58:06 user nova-compute[75113]:   </devices>
Oct 26 16:58:06 user nova-compute[75113]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 16:58:06 user nova-compute[75113]:     <label>libvirt-9064edf2-de11-4223-baed-d346bfe34fcc</label>
Oct 26 16:58:06 user nova-compute[75113]:     <imagelabel>libvirt-9064edf2-de11-4223-baed-d346bfe34fcc</imagelabel>
Oct 26 16:58:06 user nova-compute[75113]:   </seclabel>
Oct 26 16:58:06 user nova-compute[75113]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 16:58:06 user nova-compute[75113]:     <label>+64055:+108</label>
Oct 26 16:58:06 user nova-compute[75113]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 16:58:06 user nova-compute[75113]:   </seclabel>
Oct 26 16:58:06 user nova-compute[75113]: </domain>
Oct 26 16:58:06 user nova-compute[75113]:  {{(pid=75113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:79:25:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tap528921b8-dc"/></interface> {{(pid=75113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:79:25:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tap528921b8-dc"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 26 16:58:06 user nova-compute[75113]:   <name>instance-00000008</name>
Oct 26 16:58:06 user nova-compute[75113]:   <uuid>9064edf2-de11-4223-baed-d346bfe34fcc</uuid>
Oct 26 16:58:06 user nova-compute[75113]:   <metadata>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:58:06 user nova-compute[75113]:   <nova:package version="0.0.0"/>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:name>tempest-device-tagging-server-1384773775</nova:name>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:creationTime>2023-10-26 16:58:06</nova:creationTime>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:flavor name="m1.tiny">
Oct 26 16:58:06 user nova-compute[75113]:     <nova:memory>512</nova:memory>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:disk>1</nova:disk>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:swap>0</nova:swap>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:vcpus>1</nova:vcpus>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:flavor>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:owner>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:user uuid="c3b34c772fc54da89ff6787f12fef797">tempest-TaggedAttachmentsTest-508694228-project-member</nova:user>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:project uuid="87c7a88071a24c96abb06407c59a2775">tempest-TaggedAttachmentsTest-508694228</nova:project>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:owner>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:ports>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:port uuid="b55efe74-8efe-4e0d-a917-a9c47cae9a85">
Oct 26 16:58:06 user nova-compute[75113]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 16:58:06 user nova-compute[75113]:     </nova:port>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:ports>
Oct 26 16:58:06 user nova-compute[75113]: </nova:instance>
Oct 26 16:58:06 user nova-compute[75113]:   </metadata>
Oct 26 16:58:06 user nova-compute[75113]:   <memory unit='KiB'>524288</memory>
Oct 26 16:58:06 user nova-compute[75113]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 16:58:06 user nova-compute[75113]:   <vcpu placement='static'>1</vcpu>
Oct 26 16:58:06 user nova-compute[75113]:   <resource>
Oct 26 16:58:06 user nova-compute[75113]:     <partition>/machine</partition>
Oct 26 16:58:06 user nova-compute[75113]:   </resource>
Oct 26 16:58:06 user nova-compute[75113]:   <sysinfo type='smbios'>
Oct 26 16:58:06 user nova-compute[75113]:     <system>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='version'>0.0.0</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='serial'>9064edf2-de11-4223-baed-d346bfe34fcc</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='uuid'>9064edf2-de11-4223-baed-d346bfe34fcc</entry>
Oct 26 16:58:06 user nova-compute[75113]:       <entry name='family'>Virtual Machine</entry>
Oct 26 16:58:06 user nova-compute[75113]:     </system>
Oct 26 16:58:06 user nova-compute[75113]:   </sysinfo>
Oct 26 16:58:06 user nova-compute[75113]:   <os>
Oct 26 16:58:06 user nova-compute[75113]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 16:58:06 user nova-compute[75113]:     <boot dev='hd'/>
Oct 26 16:58:06 user nova-compute[75113]:     <smbios mode='sysinfo'/>
Oct 26 16:58:06 user nova-compute[75113]:   </os>
Oct 26 16:58:06 user nova-compute[75113]:   <features>
Oct 26 16:58:06 user nova-compute[75113]:     <acpi/>
Oct 26 16:58:06 user nova-compute[75113]:     <apic/>
Oct 26 16:58:06 user nova-compute[75113]:     <vmcoreinfo state='on'/>
Oct 26 16:58:06 user nova-compute[75113]:   </features>
Oct 26 16:58:06 user nova-compute[75113]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 16:58:06 user nova-compute[75113]:     <model fallback='forbid'>Nehalem</model>
Oct 26 16:58:06 user nova-compute[75113]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 16:58:06 user nova-compute[75113]:     <feature policy='require' name='vme'/>
Oct 26 16:58:06 user nova-compute[75113]:     <feature policy='require' name='x2apic'/>
Oct 26 16:58:06 user nova-compute[75113]:     <feature policy='require' name='hypervisor'/>
Oct 26 16:58:06 user nova-compute[75113]:   </cpu>
Oct 26 16:58:06 user nova-compute[75113]:   <clock offset='utc'>
Oct 26 16:58:06 user nova-compute[75113]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 16:58:06 user nova-compute[75113]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 16:58:06 user nova-compute[75113]:     <timer name='hpet' present='no'/>
Oct 26 16:58:06 user nova-compute[75113]:   </clock>
Oct 26 16:58:06 user nova-compute[75113]:   <on_poweroff>destroy</on_poweroff>
Oct 26 16:58:06 user nova-compute[75113]:   <on_reboot>restart</on_reboot>
Oct 26 16:58:06 user nova-compute[75113]:   <on_crash>destroy</on_crash>
Oct 26 16:58:06 user nova-compute[75113]:   <devices>
Oct 26 16:58:06 user nova-compute[75113]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 16:58:06 user nova-compute[75113]:     <disk type='file' device='disk'>
Oct 26 16:58:06 user nova-compute[75113]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 16:58:06 user nova-compute[75113]:       <source file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk' index='2'/>
Oct 26 16:58:06 user nova-compute[75113]:       <backingStore type='file' index='3'>
Oct 26 16:58:06 user nova-compute[75113]:         <format type='raw'/>
Oct 26 16:58:06 user nova-compute[75113]:         <source file='/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0'/>
Oct 26 16:58:06 user nova-compute[75113]:         <backingStore/>
Oct 26 16:58:06 user nova-compute[75113]:       </backingStore>
Oct 26 16:58:06 user nova-compute[75113]:       <target dev='vda' bus='virtio'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='virtio-disk0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </disk>
Oct 26 16:58:06 user nova-compute[75113]:     <disk type='file' device='cdrom'>
Oct 26 16:58:06 user nova-compute[75113]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 16:58:06 user nova-compute[75113]:       <source file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/disk.config' index='1'/>
Oct 26 16:58:06 user nova-compute[75113]:       <backingStore/>
Oct 26 16:58:06 user nova-compute[75113]:       <target dev='hda' bus='ide'/>
Oct 26 16:58:06 user nova-compute[75113]:       <readonly/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='ide0-0-0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </disk>
Oct 26 16:58:06 user nova-compute[75113]:     <controller type='usb' index='0' model='none'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='usb'/>
Oct 26 16:58:06 user nova-compute[75113]:     </controller>
Oct 26 16:58:06 user nova-compute[75113]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='pci.0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </controller>
Oct 26 16:58:06 user nova-compute[75113]:     <controller type='ide' index='0'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='ide'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 16:58:06 user nova-compute[75113]:     </controller>
Oct 26 16:58:06 user nova-compute[75113]:     <interface type='ethernet'>
Oct 26 16:58:06 user nova-compute[75113]:       <mac address='fa:16:3e:84:a4:ac'/>
Oct 26 16:58:06 user nova-compute[75113]:       <target dev='tapb55efe74-8e'/>
Oct 26 16:58:06 user nova-compute[75113]:       <model type='virtio'/>
Oct 26 16:58:06 user nova-compute[75113]:       <mtu size='1442'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='net0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </interface>
Oct 26 16:58:06 user nova-compute[75113]:     <serial type='pty'>
Oct 26 16:58:06 user nova-compute[75113]:       <source path='/dev/pts/7'/>
Oct 26 16:58:06 user nova-compute[75113]:       <log file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/console.log' append='off'/>
Oct 26 16:58:06 user nova-compute[75113]:       <target type='isa-serial' port='0'>
Oct 26 16:58:06 user nova-compute[75113]:         <model name='isa-serial'/>
Oct 26 16:58:06 user nova-compute[75113]:       </target>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='serial0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </serial>
Oct 26 16:58:06 user nova-compute[75113]:     <console type='pty' tty='/dev/pts/7'>
Oct 26 16:58:06 user nova-compute[75113]:       <source path='/dev/pts/7'/>
Oct 26 16:58:06 user nova-compute[75113]:       <log file='/opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc/console.log' append='off'/>
Oct 26 16:58:06 user nova-compute[75113]:       <target type='serial' port='0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='serial0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </console>
Oct 26 16:58:06 user nova-compute[75113]:     <input type='mouse' bus='ps2'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='input0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </input>
Oct 26 16:58:06 user nova-compute[75113]:     <input type='keyboard' bus='ps2'>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='input1'/>
Oct 26 16:58:06 user nova-compute[75113]:     </input>
Oct 26 16:58:06 user nova-compute[75113]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 26 16:58:06 user nova-compute[75113]:       <listen type='address' address='0.0.0.0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </graphics>
Oct 26 16:58:06 user nova-compute[75113]:     <audio id='1' type='none'/>
Oct 26 16:58:06 user nova-compute[75113]:     <video>
Oct 26 16:58:06 user nova-compute[75113]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='video0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </video>
Oct 26 16:58:06 user nova-compute[75113]:     <memballoon model='virtio'>
Oct 26 16:58:06 user nova-compute[75113]:       <stats period='10'/>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='balloon0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </memballoon>
Oct 26 16:58:06 user nova-compute[75113]:     <rng model='virtio'>
Oct 26 16:58:06 user nova-compute[75113]:       <backend model='random'>/dev/urandom</backend>
Oct 26 16:58:06 user nova-compute[75113]:       <alias name='rng0'/>
Oct 26 16:58:06 user nova-compute[75113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 16:58:06 user nova-compute[75113]:     </rng>
Oct 26 16:58:06 user nova-compute[75113]:   </devices>
Oct 26 16:58:06 user nova-compute[75113]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 16:58:06 user nova-compute[75113]:     <label>libvirt-9064edf2-de11-4223-baed-d346bfe34fcc</label>
Oct 26 16:58:06 user nova-compute[75113]:     <imagelabel>libvirt-9064edf2-de11-4223-baed-d346bfe34fcc</imagelabel>
Oct 26 16:58:06 user nova-compute[75113]:   </seclabel>
Oct 26 16:58:06 user nova-compute[75113]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 16:58:06 user nova-compute[75113]:     <label>+64055:+108</label>
Oct 26 16:58:06 user nova-compute[75113]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 16:58:06 user nova-compute[75113]:   </seclabel>
Oct 26 16:58:06 user nova-compute[75113]: </domain>
Oct 26 16:58:06 user nova-compute[75113]:  {{(pid=75113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 16:58:06 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Detaching interface fa:16:3e:79:25:b9 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap528921b8-dc' not found.
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1384773775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1384773775',id=8,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESp5K/14Ggl6vrqYPJZwPerrbYDesNlYVE2P8OiIAmeuCFyfagPIf0wDUE44PKomsOLEBGK5zvmXNCoV246gjfXa+oGWMEfMNs4yKfAzQiMGQTrxjH+/YVUO6sO4X+6vw==',key_name='tempest-keypair-1710846497',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87c7a88071a24c96abb06407c59a2775',ramdisk_id='',reservation_id='r-0pxw2si0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-508694228',owner_user_name='tempest-TaggedAttachmentsTest-508694228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3b34c772fc54da89ff6787f12fef797',uuid=9064edf2-de11-4223-baed-d346bfe34fcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.network.os_vif_util [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] Converting VIF {"id": "528921b8-dc12-49ae-844c-26313949e09e", "address": "fa:16:3e:79:25:b9", "network": {"id": "891dc6b2-cbc0-4f37-b84b-0e618790a183", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1914997817", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528921b8-dc", "ovs_interfaceid": "528921b8-dc12-49ae-844c-26313949e09e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.network.os_vif_util [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:25:b9,bridge_name='br-int',has_traffic_filtering=True,id=528921b8-dc12-49ae-844c-26313949e09e,network=Network(891dc6b2-cbc0-4f37-b84b-0e618790a183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528921b8-dc') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG os_vif [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:25:b9,bridge_name='br-int',has_traffic_filtering=True,id=528921b8-dc12-49ae-844c-26313949e09e,network=Network(891dc6b2-cbc0-4f37-b84b-0e618790a183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528921b8-dc') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap528921b8-dc, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:58:06 user nova-compute[75113]: INFO os_vif [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:25:b9,bridge_name='br-int',has_traffic_filtering=True,id=528921b8-dc12-49ae-844c-26313949e09e,network=Network(891dc6b2-cbc0-4f37-b84b-0e618790a183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528921b8-dc')
Oct 26 16:58:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [req-155e5f7f-45b7-4b99-bceb-b57ea46bfe09 req-eca87bf4-6dd2-465f-9c61-6b7aa0872b18 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:58:06 user nova-compute[75113]:   <nova:package version="0.0.0"/>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:name>tempest-device-tagging-server-1384773775</nova:name>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:creationTime>2023-10-26 16:58:06</nova:creationTime>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:flavor name="m1.tiny">
Oct 26 16:58:06 user nova-compute[75113]:     <nova:memory>512</nova:memory>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:disk>1</nova:disk>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:swap>0</nova:swap>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:vcpus>1</nova:vcpus>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:flavor>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:owner>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:user uuid="c3b34c772fc54da89ff6787f12fef797">tempest-TaggedAttachmentsTest-508694228-project-member</nova:user>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:project uuid="87c7a88071a24c96abb06407c59a2775">tempest-TaggedAttachmentsTest-508694228</nova:project>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:owner>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:58:06 user nova-compute[75113]:   <nova:ports>
Oct 26 16:58:06 user nova-compute[75113]:     <nova:port uuid="b55efe74-8efe-4e0d-a917-a9c47cae9a85">
Oct 26 16:58:06 user nova-compute[75113]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 16:58:06 user nova-compute[75113]:     </nova:port>
Oct 26 16:58:06 user nova-compute[75113]:   </nova:ports>
Oct 26 16:58:06 user nova-compute[75113]: </nova:instance>
Oct 26 16:58:06 user nova-compute[75113]:  {{(pid=75113) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 16:58:07 user nova-compute[75113]: DEBUG nova.network.neutron [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Updating instance_info_cache with network_info: [{"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:58:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Releasing lock "refresh_cache-9064edf2-de11-4223-baed-d346bfe34fcc" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:58:07 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:58:07 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:58:07 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:58:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-32ff324c-3c23-41c2-afe1-64be8da77924 tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "interface-9064edf2-de11-4223-baed-d346bfe34fcc-528921b8-dc12-49ae-844c-26313949e09e" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.530s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXqImyNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:58:16 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:58:16 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:58:16 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c780ea-2717-46fb-813f-a233a7945f77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:58:16 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[483550ff-f7cd-4967-9624-de00f69f88d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00] added
Oct 26 16:58:16 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d63353e-8602-42a9-b2c5-d04cfba26292]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[792d0b26-6935-4c58-a688-b80f915bb2ba]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXqImyNs {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXqImyNs" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0324f52-6e60-48a9-a34a-7174c5b6415f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tXqImyNs'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e024d9b-ff31-47ea-8309-bcc9bd0b129d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea032576-44e1-4efb-aea7-e2d5ae4966b9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:58:16 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:58:16 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0b2934-94fd-4b97-a76b-b3e6d491bb71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00, portal: 172.16.0.220,3260]
Oct 26 16:58:16 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00, portal: 172.16.0.220,3260] successful.
Oct 26 16:58:16 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea20eae6-3c6f-4e29-8e40-99b4f52314ff]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c299ae-09ee-4c25-8962-75121df9d19d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:58:16 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:58:16 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:58:16 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe5ee50-af26-4f25-8eb0-41377c910d14]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:16 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:58:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:17 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:58:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXqImyNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:58:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:58:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23363386137613638', 'path': '/dev/sde'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:58:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363386137613638', 'path': '/dev/sde'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:58:17 user nova-compute[75113]: DEBUG nova.objects.instance [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lazy-loading 'flavor' on Instance uuid 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:58:17 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:58:17 user nova-compute[75113]:   <source dev="/dev/sde"/>
Oct 26 16:58:17 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:58:17 user nova-compute[75113]:   <serial>80806a8c-ae83-411e-b575-f4ccb122db00</serial>
Oct 26 16:58:17 user nova-compute[75113]: </disk>
Oct 26 16:58:17 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:58:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:58:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:58:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] No VIF found with MAC fa:16:3e:bf:13:99, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:58:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e53b948b-fd20-4b0d-a321-774060621b1c tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "69ed2396-a603-4c84-a66b-7b474523b68e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.304s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "413deca1-2056-455a-b7c6-e0730ea1a57e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:58:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "04f0351c-6347-4353-bc70-ffa74158496c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "04f0351c-6347-4353-bc70-ffa74158496c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:58:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:18 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:58:18 user nova-compute[75113]: INFO nova.compute.claims [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Claim successful on node user
Oct 26 16:58:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.400s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:58:19 user nova-compute[75113]: INFO nova.compute.claims [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Claim successful on node user
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:58:19 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.policy [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9ca04a69e784bc38c31b5ca256d3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ee9d2be45d4517a2cfea00177b1c15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:58:19 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Creating image(s)
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "/opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "/opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "/opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:19 user nova-compute[75113]: INFO nova.compute.manager [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Rescuing
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquired lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.199s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.241s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Successfully created port: 43ab0866-ca31-415e-bf5c-a5a7cc93f39a {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk 1073741824" returned: 0 in 0.098s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:19 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:58:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.policy [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c431350f06fd4dbf8d74835f34626ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae5d124cb054dfbbe04433a685903bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.188s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Checking if we can resize image /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:58:20 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Creating image(s)
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "/opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "/opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "/opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Cannot resize image /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Ensure instance console log exists: /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updating instance_info_cache with network_info: [{"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Releasing lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Successfully updated port: 43ab0866-ca31-415e-bf5c-a5a7cc93f39a {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.196s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-041017a1-2a23-4a6f-8418-9c5650e30610 req-540f8653-cefb-43b5-bedc-d5b62a2202d3 service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Received event network-changed-43ab0866-ca31-415e-bf5c-a5a7cc93f39a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-041017a1-2a23-4a6f-8418-9c5650e30610 req-540f8653-cefb-43b5-bedc-d5b62a2202d3 service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Refreshing instance network info cache due to event network-changed-43ab0866-ca31-415e-bf5c-a5a7cc93f39a. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-041017a1-2a23-4a6f-8418-9c5650e30610 req-540f8653-cefb-43b5-bedc-d5b62a2202d3 service nova] Acquiring lock "refresh_cache-413deca1-2056-455a-b7c6-e0730ea1a57e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-041017a1-2a23-4a6f-8418-9c5650e30610 req-540f8653-cefb-43b5-bedc-d5b62a2202d3 service nova] Acquired lock "refresh_cache-413deca1-2056-455a-b7c6-e0730ea1a57e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.network.neutron [req-041017a1-2a23-4a6f-8418-9c5650e30610 req-540f8653-cefb-43b5-bedc-d5b62a2202d3 service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Refreshing network info cache for port 43ab0866-ca31-415e-bf5c-a5a7cc93f39a {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "refresh_cache-413deca1-2056-455a-b7c6-e0730ea1a57e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk 1073741824" returned: 0 in 0.078s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.network.neutron [req-041017a1-2a23-4a6f-8418-9c5650e30610 req-540f8653-cefb-43b5-bedc-d5b62a2202d3 service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.219s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Successfully created port: de147975-aa0e-4028-af5f-a92993f17b8f {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:58:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Cannot resize image /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Ensure instance console log exists: /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:21 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Instance destroyed successfully.
Oct 26 16:58:21 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Attempting a stable device rescue
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.network.neutron [req-041017a1-2a23-4a6f-8418-9c5650e30610 req-540f8653-cefb-43b5-bedc-d5b62a2202d3 service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-041017a1-2a23-4a6f-8418-9c5650e30610 req-540f8653-cefb-43b5-bedc-d5b62a2202d3 service nova] Releasing lock "refresh_cache-413deca1-2056-455a-b7c6-e0730ea1a57e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquired lock "refresh_cache-413deca1-2056-455a-b7c6-e0730ea1a57e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75113) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Instance directory exists: not creating {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 16:58:21 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Creating image(s)
Oct 26 16:58:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "/opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "/opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "/opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.objects.instance [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lazy-loading 'trusted_certs' on Instance uuid 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "f10d3511bd3bcf0f8133b1d3947ed065740bf90a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "f10d3511bd3bcf0f8133b1d3947ed065740bf90a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Updating instance_info_cache with network_info: [{"id": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "address": "fa:16:3e:22:a3:1d", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab0866-ca", "ovs_interfaceid": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Releasing lock "refresh_cache-413deca1-2056-455a-b7c6-e0730ea1a57e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Instance network_info: |[{"id": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "address": "fa:16:3e:22:a3:1d", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab0866-ca", "ovs_interfaceid": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Start _get_guest_xml network_info=[{"id": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "address": "fa:16:3e:22:a3:1d", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab0866-ca", "ovs_interfaceid": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:58:21 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:58:21 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-173446413',display_name='tempest-VolumesAdminNegativeTest-server-173446413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-173446413',id=12,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66ee9d2be45d4517a2cfea00177b1c15',ramdisk_id='',reservation_id='r-yfgpykbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1147285819',owner_user_name='tempest-VolumesAdminNegativeTest-1147285819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:58:19Z,user_data=None,user_id='f9ca04a69e784bc38c31b5ca256d3a94',uuid=413deca1-2056-455a-b7c6-e0730ea1a57e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "address": "fa:16:3e:22:a3:1d", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab0866-ca", "ovs_interfaceid": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Converting VIF {"id": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "address": "fa:16:3e:22:a3:1d", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab0866-ca", "ovs_interfaceid": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:a3:1d,bridge_name='br-int',has_traffic_filtering=True,id=43ab0866-ca31-415e-bf5c-a5a7cc93f39a,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab0866-ca') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lazy-loading 'pci_devices' on Instance uuid 413deca1-2056-455a-b7c6-e0730ea1a57e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:58:21 user nova-compute[75113]:   <uuid>413deca1-2056-455a-b7c6-e0730ea1a57e</uuid>
Oct 26 16:58:21 user nova-compute[75113]:   <name>instance-0000000c</name>
Oct 26 16:58:21 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:58:21 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:58:21 user nova-compute[75113]:   <metadata>
Oct 26 16:58:21 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:58:21 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:58:21 user nova-compute[75113]:       <nova:name>tempest-VolumesAdminNegativeTest-server-173446413</nova:name>
Oct 26 16:58:21 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:58:21</nova:creationTime>
Oct 26 16:58:21 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:58:21 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:58:21 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:58:21 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:58:21 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:58:21 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:58:21 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:58:21 user nova-compute[75113]:       <nova:owner>
Oct 26 16:58:21 user nova-compute[75113]:         <nova:user uuid="f9ca04a69e784bc38c31b5ca256d3a94">tempest-VolumesAdminNegativeTest-1147285819-project-member</nova:user>
Oct 26 16:58:21 user nova-compute[75113]:         <nova:project uuid="66ee9d2be45d4517a2cfea00177b1c15">tempest-VolumesAdminNegativeTest-1147285819</nova:project>
Oct 26 16:58:21 user nova-compute[75113]:       </nova:owner>
Oct 26 16:58:21 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:58:21 user nova-compute[75113]:       <nova:ports>
Oct 26 16:58:21 user nova-compute[75113]:         <nova:port uuid="43ab0866-ca31-415e-bf5c-a5a7cc93f39a">
Oct 26 16:58:21 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 16:58:21 user nova-compute[75113]:         </nova:port>
Oct 26 16:58:21 user nova-compute[75113]:       </nova:ports>
Oct 26 16:58:21 user nova-compute[75113]:     </nova:instance>
Oct 26 16:58:21 user nova-compute[75113]:   </metadata>
Oct 26 16:58:21 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:58:21 user nova-compute[75113]:     <system>
Oct 26 16:58:21 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:58:21 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:58:21 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:58:21 user nova-compute[75113]:       <entry name="serial">413deca1-2056-455a-b7c6-e0730ea1a57e</entry>
Oct 26 16:58:21 user nova-compute[75113]:       <entry name="uuid">413deca1-2056-455a-b7c6-e0730ea1a57e</entry>
Oct 26 16:58:21 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:58:21 user nova-compute[75113]:     </system>
Oct 26 16:58:21 user nova-compute[75113]:   </sysinfo>
Oct 26 16:58:21 user nova-compute[75113]:   <os>
Oct 26 16:58:21 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:58:21 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:58:21 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:58:21 user nova-compute[75113]:   </os>
Oct 26 16:58:21 user nova-compute[75113]:   <features>
Oct 26 16:58:21 user nova-compute[75113]:     <acpi/>
Oct 26 16:58:21 user nova-compute[75113]:     <apic/>
Oct 26 16:58:21 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:58:21 user nova-compute[75113]:   </features>
Oct 26 16:58:21 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:58:21 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:58:21 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:58:21 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:58:21 user nova-compute[75113]:   </clock>
Oct 26 16:58:21 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:58:21 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:58:21 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:58:21 user nova-compute[75113]:   </cpu>
Oct 26 16:58:21 user nova-compute[75113]:   <devices>
Oct 26 16:58:21 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:58:21 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:58:21 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk"/>
Oct 26 16:58:21 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:58:21 user nova-compute[75113]:     </disk>
Oct 26 16:58:21 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:58:21 user nova-compute[75113]:       <mac address="fa:16:3e:22:a3:1d"/>
Oct 26 16:58:21 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:58:21 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:58:21 user nova-compute[75113]:       <target dev="tap43ab0866-ca"/>
Oct 26 16:58:21 user nova-compute[75113]:     </interface>
Oct 26 16:58:21 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:58:21 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/console.log" append="off"/>
Oct 26 16:58:21 user nova-compute[75113]:     </serial>
Oct 26 16:58:21 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:58:21 user nova-compute[75113]:     <video>
Oct 26 16:58:21 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:58:21 user nova-compute[75113]:     </video>
Oct 26 16:58:21 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:58:21 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:58:21 user nova-compute[75113]:     </rng>
Oct 26 16:58:21 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:58:21 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:58:21 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:58:21 user nova-compute[75113]:     </memballoon>
Oct 26 16:58:21 user nova-compute[75113]:   </devices>
Oct 26 16:58:21 user nova-compute[75113]: </domain>
Oct 26 16:58:21 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-173446413',display_name='tempest-VolumesAdminNegativeTest-server-173446413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-173446413',id=12,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66ee9d2be45d4517a2cfea00177b1c15',ramdisk_id='',reservation_id='r-yfgpykbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1147285819',owner_user_name='tempest-VolumesAdminNegativeTest-1147285819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:58:19Z,user_data=None,user_id='f9ca04a69e784bc38c31b5ca256d3a94',uuid=413deca1-2056-455a-b7c6-e0730ea1a57e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "address": "fa:16:3e:22:a3:1d", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab0866-ca", "ovs_interfaceid": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Converting VIF {"id": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "address": "fa:16:3e:22:a3:1d", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab0866-ca", "ovs_interfaceid": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:a3:1d,bridge_name='br-int',has_traffic_filtering=True,id=43ab0866-ca31-415e-bf5c-a5a7cc93f39a,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab0866-ca') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG os_vif [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:a3:1d,bridge_name='br-int',has_traffic_filtering=True,id=43ab0866-ca31-415e-bf5c-a5a7cc93f39a,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab0866-ca') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb96f809-ce4c-5d0c-ab7a-c86e264a02fe', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43ab0866-ca, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43ab0866-ca, col_values=(('qos', UUID('813f0e07-aa53-45af-830f-a3956b77cac3')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43ab0866-ca, col_values=(('external_ids', {'iface-id': '43ab0866-ca31-415e-bf5c-a5a7cc93f39a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:a3:1d', 'vm-uuid': '413deca1-2056-455a-b7c6-e0730ea1a57e'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:58:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:21 user nova-compute[75113]: INFO os_vif [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:a3:1d,bridge_name='br-int',has_traffic_filtering=True,id=43ab0866-ca31-415e-bf5c-a5a7cc93f39a,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab0866-ca')
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10d3511bd3bcf0f8133b1d3947ed065740bf90a.part --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Successfully updated port: de147975-aa0e-4028-af5f-a92993f17b8f {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.compute.manager [req-ee750793-689c-4b26-985e-5d19d9019085 req-c4fb3319-5f7d-4bdd-96f2-863519938021 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Received event network-changed-de147975-aa0e-4028-af5f-a92993f17b8f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.compute.manager [req-ee750793-689c-4b26-985e-5d19d9019085 req-c4fb3319-5f7d-4bdd-96f2-863519938021 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Refreshing instance network info cache due to event network-changed-de147975-aa0e-4028-af5f-a92993f17b8f. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee750793-689c-4b26-985e-5d19d9019085 req-c4fb3319-5f7d-4bdd-96f2-863519938021 service nova] Acquiring lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee750793-689c-4b26-985e-5d19d9019085 req-c4fb3319-5f7d-4bdd-96f2-863519938021 service nova] Acquired lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.network.neutron [req-ee750793-689c-4b26-985e-5d19d9019085 req-c4fb3319-5f7d-4bdd-96f2-863519938021 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Refreshing network info cache for port de147975-aa0e-4028-af5f-a92993f17b8f {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] No VIF found with MAC fa:16:3e:22:a3:1d, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.compute.manager [req-19d5d5ee-cb9c-4c38-a23f-516da066fe94 req-e5b230f0-f4d8-4bf1-a966-bbc5162e5547 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-vif-unplugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-19d5d5ee-cb9c-4c38-a23f-516da066fe94 req-e5b230f0-f4d8-4bf1-a966-bbc5162e5547 service nova] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-19d5d5ee-cb9c-4c38-a23f-516da066fe94 req-e5b230f0-f4d8-4bf1-a966-bbc5162e5547 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-19d5d5ee-cb9c-4c38-a23f-516da066fe94 req-e5b230f0-f4d8-4bf1-a966-bbc5162e5547 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.compute.manager [req-19d5d5ee-cb9c-4c38-a23f-516da066fe94 req-e5b230f0-f4d8-4bf1-a966-bbc5162e5547 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] No waiting events found dispatching network-vif-unplugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:22 user nova-compute[75113]: WARNING nova.compute.manager [req-19d5d5ee-cb9c-4c38-a23f-516da066fe94 req-e5b230f0-f4d8-4bf1-a966-bbc5162e5547 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received unexpected event network-vif-unplugged-0502d8bd-666e-4f27-8c38-e060b44ce264 for instance with vm_state active and task_state rescuing.
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.compute.manager [req-19d5d5ee-cb9c-4c38-a23f-516da066fe94 req-e5b230f0-f4d8-4bf1-a966-bbc5162e5547 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-19d5d5ee-cb9c-4c38-a23f-516da066fe94 req-e5b230f0-f4d8-4bf1-a966-bbc5162e5547 service nova] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-19d5d5ee-cb9c-4c38-a23f-516da066fe94 req-e5b230f0-f4d8-4bf1-a966-bbc5162e5547 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-19d5d5ee-cb9c-4c38-a23f-516da066fe94 req-e5b230f0-f4d8-4bf1-a966-bbc5162e5547 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.compute.manager [req-19d5d5ee-cb9c-4c38-a23f-516da066fe94 req-e5b230f0-f4d8-4bf1-a966-bbc5162e5547 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] No waiting events found dispatching network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:22 user nova-compute[75113]: WARNING nova.compute.manager [req-19d5d5ee-cb9c-4c38-a23f-516da066fe94 req-e5b230f0-f4d8-4bf1-a966-bbc5162e5547 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received unexpected event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 for instance with vm_state active and task_state rescuing.
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.network.neutron [req-ee750793-689c-4b26-985e-5d19d9019085 req-c4fb3319-5f7d-4bdd-96f2-863519938021 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10d3511bd3bcf0f8133b1d3947ed065740bf90a.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.virt.images [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] 6b73acd1-5a16-46bd-bb1e-96a8d453552e was qcow2, converting to raw {{(pid=75113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f10d3511bd3bcf0f8133b1d3947ed065740bf90a.part /opt/stack/data/nova/instances/_base/f10d3511bd3bcf0f8133b1d3947ed065740bf90a.converted {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.network.neutron [req-ee750793-689c-4b26-985e-5d19d9019085 req-c4fb3319-5f7d-4bdd-96f2-863519938021 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee750793-689c-4b26-985e-5d19d9019085 req-c4fb3319-5f7d-4bdd-96f2-863519938021 service nova] Releasing lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquired lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f10d3511bd3bcf0f8133b1d3947ed065740bf90a.part /opt/stack/data/nova/instances/_base/f10d3511bd3bcf0f8133b1d3947ed065740bf90a.converted" returned: 0 in 0.270s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10d3511bd3bcf0f8133b1d3947ed065740bf90a.converted --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10d3511bd3bcf0f8133b1d3947ed065740bf90a.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "f10d3511bd3bcf0f8133b1d3947ed065740bf90a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.860s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "f10d3511bd3bcf0f8133b1d3947ed065740bf90a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "f10d3511bd3bcf0f8133b1d3947ed065740bf90a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10d3511bd3bcf0f8133b1d3947ed065740bf90a --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Updating instance_info_cache with network_info: [{"id": "de147975-aa0e-4028-af5f-a92993f17b8f", "address": "fa:16:3e:47:99:24", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde147975-aa", "ovs_interfaceid": "de147975-aa0e-4028-af5f-a92993f17b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Releasing lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Instance network_info: |[{"id": "de147975-aa0e-4028-af5f-a92993f17b8f", "address": "fa:16:3e:47:99:24", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde147975-aa", "ovs_interfaceid": "de147975-aa0e-4028-af5f-a92993f17b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Start _get_guest_xml network_info=[{"id": "de147975-aa0e-4028-af5f-a92993f17b8f", "address": "fa:16:3e:47:99:24", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde147975-aa", "ovs_interfaceid": "de147975-aa0e-4028-af5f-a92993f17b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10d3511bd3bcf0f8133b1d3947ed065740bf90a --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f10d3511bd3bcf0f8133b1d3947ed065740bf90a,backing_fmt=raw /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.rescue {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:23 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:58:23 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f10d3511bd3bcf0f8133b1d3947ed065740bf90a,backing_fmt=raw /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.rescue" returned: 0 in 0.051s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "f10d3511bd3bcf0f8133b1d3947ed065740bf90a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.objects.instance [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lazy-loading 'migration_context' on Instance uuid 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1334981408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1334981408',id=13,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-sqaq5djn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:58:20Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=04f0351c-6347-4353-bc70-ffa74158496c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de147975-aa0e-4028-af5f-a92993f17b8f", "address": "fa:16:3e:47:99:24", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde147975-aa", "ovs_interfaceid": "de147975-aa0e-4028-af5f-a92993f17b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "de147975-aa0e-4028-af5f-a92993f17b8f", "address": "fa:16:3e:47:99:24", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde147975-aa", "ovs_interfaceid": "de147975-aa0e-4028-af5f-a92993f17b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:99:24,bridge_name='br-int',has_traffic_filtering=True,id=de147975-aa0e-4028-af5f-a92993f17b8f,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde147975-aa') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'pci_devices' on Instance uuid 04f0351c-6347-4353-bc70-ffa74158496c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.objects.base [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Object Instance<69ed2396-a603-4c84-a66b-7b474523b68e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Start _get_guest_xml network_info=[{"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "vif_mac": "fa:16:3e:bf:13:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6b73acd1-5a16-46bd-bb1e-96a8d453552e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b3ce3389-f27c-44c8-bf61-3f7e701a7006', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXqImyNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '69ed2396-a603-4c84-a66b-7b474523b68e', 'attached_at': '', 'detached_at': '', 'volume_id': '80806a8c-ae83-411e-b575-f4ccb122db00', 'serial': '80806a8c-ae83-411e-b575-f4ccb122db00'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.objects.instance [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lazy-loading 'resources' on Instance uuid 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:58:23 user nova-compute[75113]:   <uuid>04f0351c-6347-4353-bc70-ffa74158496c</uuid>
Oct 26 16:58:23 user nova-compute[75113]:   <name>instance-0000000d</name>
Oct 26 16:58:23 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:58:23 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:58:23 user nova-compute[75113]:   <metadata>
Oct 26 16:58:23 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:58:23 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:58:23 user nova-compute[75113]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1334981408</nova:name>
Oct 26 16:58:23 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:58:23</nova:creationTime>
Oct 26 16:58:23 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:58:23 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:58:23 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:58:23 user nova-compute[75113]:       <nova:owner>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:user uuid="c431350f06fd4dbf8d74835f34626ee7">tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member</nova:user>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:project uuid="9ae5d124cb054dfbbe04433a685903bc">tempest-ServerBootFromVolumeStableRescueTest-2080298495</nova:project>
Oct 26 16:58:23 user nova-compute[75113]:       </nova:owner>
Oct 26 16:58:23 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:58:23 user nova-compute[75113]:       <nova:ports>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:port uuid="de147975-aa0e-4028-af5f-a92993f17b8f">
Oct 26 16:58:23 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 16:58:23 user nova-compute[75113]:         </nova:port>
Oct 26 16:58:23 user nova-compute[75113]:       </nova:ports>
Oct 26 16:58:23 user nova-compute[75113]:     </nova:instance>
Oct 26 16:58:23 user nova-compute[75113]:   </metadata>
Oct 26 16:58:23 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:58:23 user nova-compute[75113]:     <system>
Oct 26 16:58:23 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:58:23 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:58:23 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:58:23 user nova-compute[75113]:       <entry name="serial">04f0351c-6347-4353-bc70-ffa74158496c</entry>
Oct 26 16:58:23 user nova-compute[75113]:       <entry name="uuid">04f0351c-6347-4353-bc70-ffa74158496c</entry>
Oct 26 16:58:23 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:58:23 user nova-compute[75113]:     </system>
Oct 26 16:58:23 user nova-compute[75113]:   </sysinfo>
Oct 26 16:58:23 user nova-compute[75113]:   <os>
Oct 26 16:58:23 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:58:23 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:58:23 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:58:23 user nova-compute[75113]:   </os>
Oct 26 16:58:23 user nova-compute[75113]:   <features>
Oct 26 16:58:23 user nova-compute[75113]:     <acpi/>
Oct 26 16:58:23 user nova-compute[75113]:     <apic/>
Oct 26 16:58:23 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:58:23 user nova-compute[75113]:   </features>
Oct 26 16:58:23 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:58:23 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:58:23 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:58:23 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:58:23 user nova-compute[75113]:   </clock>
Oct 26 16:58:23 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:58:23 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:58:23 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:58:23 user nova-compute[75113]:   </cpu>
Oct 26 16:58:23 user nova-compute[75113]:   <devices>
Oct 26 16:58:23 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:58:23 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:58:23 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk"/>
Oct 26 16:58:23 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:58:23 user nova-compute[75113]:     </disk>
Oct 26 16:58:23 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:58:23 user nova-compute[75113]:       <mac address="fa:16:3e:47:99:24"/>
Oct 26 16:58:23 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:58:23 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:58:23 user nova-compute[75113]:       <target dev="tapde147975-aa"/>
Oct 26 16:58:23 user nova-compute[75113]:     </interface>
Oct 26 16:58:23 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:58:23 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/console.log" append="off"/>
Oct 26 16:58:23 user nova-compute[75113]:     </serial>
Oct 26 16:58:23 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:58:23 user nova-compute[75113]:     <video>
Oct 26 16:58:23 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:58:23 user nova-compute[75113]:     </video>
Oct 26 16:58:23 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:58:23 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:58:23 user nova-compute[75113]:     </rng>
Oct 26 16:58:23 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:58:23 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:58:23 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:58:23 user nova-compute[75113]:     </memballoon>
Oct 26 16:58:23 user nova-compute[75113]:   </devices>
Oct 26 16:58:23 user nova-compute[75113]: </domain>
Oct 26 16:58:23 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1334981408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1334981408',id=13,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-sqaq5djn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:58:20Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=04f0351c-6347-4353-bc70-ffa74158496c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de147975-aa0e-4028-af5f-a92993f17b8f", "address": "fa:16:3e:47:99:24", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde147975-aa", "ovs_interfaceid": "de147975-aa0e-4028-af5f-a92993f17b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "de147975-aa0e-4028-af5f-a92993f17b8f", "address": "fa:16:3e:47:99:24", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde147975-aa", "ovs_interfaceid": "de147975-aa0e-4028-af5f-a92993f17b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:99:24,bridge_name='br-int',has_traffic_filtering=True,id=de147975-aa0e-4028-af5f-a92993f17b8f,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde147975-aa') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_vif [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:99:24,bridge_name='br-int',has_traffic_filtering=True,id=de147975-aa0e-4028-af5f-a92993f17b8f,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde147975-aa') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.objects.base [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Object Instance<69ed2396-a603-4c84-a66b-7b474523b68e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.objects.instance [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lazy-loading 'numa_topology' on Instance uuid 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90d1fbe6-db8a-5a1a-80c6-77de88d11d29', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.objects.base [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Object Instance<69ed2396-a603-4c84-a66b-7b474523b68e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:58:23 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:58:23 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.objects.instance [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde147975-aa, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde147975-aa, col_values=(('qos', UUID('451d51cf-5297-4dce-8ac8-caaac67dc91a')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde147975-aa, col_values=(('external_ids', {'iface-id': 'de147975-aa0e-4028-af5f-a92993f17b8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:99:24', 'vm-uuid': '04f0351c-6347-4353-bc70-ffa74158496c'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.objects.base [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Object Instance<69ed2396-a603-4c84-a66b-7b474523b68e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXqImyNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:58:23 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:58:23 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:58:23 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:23 user nova-compute[75113]: INFO os_vif [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:99:24,bridge_name='br-int',has_traffic_filtering=True,id=de147975-aa0e-4028-af5f-a92993f17b8f,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde147975-aa')
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e9635d-95a6-410d-809b-9a100dab4a8a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = tXqImyNs\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 16:58:23 user nova-compute[75113]: node.name = iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00
Oct 26 16:58:23 user nova-compute[75113]: node.tpgt = -1
Oct 26 16:58:23 user nova-compute[75113]: node.startup = automatic
Oct 26 16:58:23 user nova-compute[75113]: node.leading_login = No
Oct 26 16:58:23 user nova-compute[75113]: iface.iscsi_ifacename = default
Oct 26 16:58:23 user nova-compute[75113]: iface.net_ifacename = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.ipaddress = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.prefix_len = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.hwaddress = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.transport_name = tcp
Oct 26 16:58:23 user nova-compute[75113]: iface.initiatorname = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.state = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.vlan_id = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.vlan_priority = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.vlan_state = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.iface_num = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.mtu = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.port = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.bootproto = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.subnet_mask = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.gateway = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.dhcp_alt_client_id = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.dhcp_dns = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.dhcp_learn_iqn = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.dhcp_vendor_id_state = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.dhcp_vendor_id = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.dhcp_slp_da = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.fragmentation = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.gratuitous_arp = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.incoming_forwarding = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.tos_state = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.tos = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.ttl = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.delayed_ack = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.tcp_nagle = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.tcp_wsf_state = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.tcp_wsf = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.tcp_timer_scale = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.tcp_timestamp = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.redirect = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.def_task_mgmt_timeout = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.header_digest = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.data_digest = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.immediate_data = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.initial_r2t = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.data_seq_inorder = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.data_pdu_inorder = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.erl = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.max_receive_data_len = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.first_burst_len = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.max_outstanding_r2t = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.max_burst_len = 0
Oct 26 16:58:23 user nova-compute[75113]: iface.chap_auth = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.bidi_chap = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.strict_login_compliance = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.discovery_auth = <empty>
Oct 26 16:58:23 user nova-compute[75113]: iface.discovery_logout = <empty>
Oct 26 16:58:23 user nova-compute[75113]: node.discovery_address = <empty>
Oct 26 16:58:23 user nova-compute[75113]: node.discovery_port = 0
Oct 26 16:58:23 user nova-compute[75113]: node.discovery_type = static
Oct 26 16:58:23 user nova-compute[75113]: node.session.initial_cmdsn = 0
Oct 26 16:58:23 user nova-compute[75113]: node.session.initial_login_retry_max = 8
Oct 26 16:58:23 user nova-compute[75113]: node.session.xmit_thread_priority = -20
Oct 26 16:58:23 user nova-compute[75113]: node.session.cmds_max = 128
Oct 26 16:58:23 user nova-compute[75113]: node.session.queue_depth = 32
Oct 26 16:58:23 user nova-compute[75113]: node.session.nr_sessions = 1
Oct 26 16:58:23 user nova-compute[75113]: node.session.auth.authmethod = CHAP
Oct 26 16:58:23 user nova-compute[75113]: node.session.auth.username = tXqImyNs
Oct 26 16:58:23 user nova-compute[75113]: node.session.auth.password = ***
Oct 26 16:58:23 user nova-compute[75113]: node.session.auth.username_in = <empty>
Oct 26 16:58:23 user nova-compute[75113]: node.session.auth.password_in = <empty>
Oct 26 16:58:23 user nova-compute[75113]: node.session.auth.chap_algs = MD5
Oct 26 16:58:23 user nova-compute[75113]: node.session.timeo.replacement_timeout = 120
Oct 26 16:58:23 user nova-compute[75113]: node.session.err_timeo.abort_timeout = 15
Oct 26 16:58:23 user nova-compute[75113]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 16:58:23 user nova-compute[75113]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 16:58:23 user nova-compute[75113]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 16:58:23 user nova-compute[75113]: node.session.iscsi.FastAbort = Yes
Oct 26 16:58:23 user nova-compute[75113]: node.session.iscsi.InitialR2T = No
Oct 26 16:58:23 user nova-compute[75113]: node.session.iscsi.ImmediateData = Yes
Oct 26 16:58:23 user nova-compute[75113]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 16:58:23 user nova-compute[75113]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 16:58:23 user nova-compute[75113]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 16:58:23 user nova-compute[75113]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 16:58:23 user nova-compute[75113]: node.session.iscsi.MaxConnections = 1
Oct 26 16:58:23 user nova-compute[75113]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 16:58:23 user nova-compute[75113]: node.session.iscsi.ERL = 0
Oct 26 16:58:23 user nova-compute[75113]: node.session.scan = manual
Oct 26 16:58:23 user nova-compute[75113]: node.session.reopen_max = 0
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].address = 172.16.0.220
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].port = 3260
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].startup = manual
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].tcp.window_size = 524288
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].tcp.type_of_service = 0
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].timeo.logout_timeout = 15
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].timeo.login_timeout = 15
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].timeo.auth_timeout = 45
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].iscsi.DataDigest = None
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].iscsi.IFMarker = No
Oct 26 16:58:23 user nova-compute[75113]: node.conn[0].iscsi.OFMarker = No
Oct 26 16:58:23 user nova-compute[75113]: # END RECORD
Oct 26 16:58:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c8acc5-8ca1-4650-9b59-7cbde419b13d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No VIF found with MAC fa:16:3e:47:99:24, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f496bacb-a2be-47d7-868f-584b7348f1e1]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXqImyNs {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXqImyNs" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dda5ec0-6726-4e5f-9e07-6376de2cf8dc]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tXqImyNs'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bd154b-16ec-4d5f-8db7-3cebd4552873]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfcdcbd-52c6-4a16-bcd0-d6a0d95838be]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:58:23 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:58:23 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:58:23 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:58:23 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:58:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:58:23 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:58:23 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:58:23 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:58:23 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:58:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.153s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] HCTL ('36', '0', '0', 0) found on session 11 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.012s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eda371-247f-4f14-97e7-52f157137e6b]: (4, ('0 0 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Searching for a device in session 11 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXqImyNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.175s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] <== connect_volume: return (177ms) {'type': 'block', 'scsi_wwn': '23363386137613638', 'path': '/dev/sde'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363386137613638', 'path': '/dev/sde'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1913117266',display_name='tempest-ServerStableDeviceRescueTest-server-1913117266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1913117266',id=3,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW+UVAaeZhsHcgJPMCTV2xrTl4CNLS+MkerMjXHgsZ/82ki6sNGkNDlnGa3RyBILee0xpxEsN4D9jct3D9FBDbCeR7Aa5wxdczxapjdNt9OslE9CMc4aivD8gDSXppcbA==',key_name='tempest-keypair-522693316',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='992dea425f6241c2b94c1a1c970cb028',ramdisk_id='',reservation_id='r-3xgua6lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-205046583',owner_user_name='tempest-ServerStableDeviceRescueTest-205046583-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='289e367da4e444a791a556dafb7ec392',uuid=69ed2396-a603-4c84-a66b-7b474523b68e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "vif_mac": "fa:16:3e:bf:13:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Converting VIF {"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "vif_mac": "fa:16:3e:bf:13:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:13:99,bridge_name='br-int',has_traffic_filtering=True,id=0502d8bd-666e-4f27-8c38-e060b44ce264,network=Network(0cce3e7a-230f-426f-9807-14feb9122e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0502d8bd-66') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.objects.instance [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lazy-loading 'pci_devices' on Instance uuid 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.objects.base [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Object Instance<69ed2396-a603-4c84-a66b-7b474523b68e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:58:23 user nova-compute[75113]:   <uuid>69ed2396-a603-4c84-a66b-7b474523b68e</uuid>
Oct 26 16:58:23 user nova-compute[75113]:   <name>instance-00000003</name>
Oct 26 16:58:23 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:58:23 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:58:23 user nova-compute[75113]:   <metadata>
Oct 26 16:58:23 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:58:23 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:58:23 user nova-compute[75113]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1913117266</nova:name>
Oct 26 16:58:23 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:58:23</nova:creationTime>
Oct 26 16:58:23 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:58:23 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:58:23 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:58:23 user nova-compute[75113]:       <nova:owner>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:user uuid="289e367da4e444a791a556dafb7ec392">tempest-ServerStableDeviceRescueTest-205046583-project-member</nova:user>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:project uuid="992dea425f6241c2b94c1a1c970cb028">tempest-ServerStableDeviceRescueTest-205046583</nova:project>
Oct 26 16:58:23 user nova-compute[75113]:       </nova:owner>
Oct 26 16:58:23 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:58:23 user nova-compute[75113]:       <nova:ports>
Oct 26 16:58:23 user nova-compute[75113]:         <nova:port uuid="0502d8bd-666e-4f27-8c38-e060b44ce264">
Oct 26 16:58:23 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 16:58:23 user nova-compute[75113]:         </nova:port>
Oct 26 16:58:23 user nova-compute[75113]:       </nova:ports>
Oct 26 16:58:23 user nova-compute[75113]:     </nova:instance>
Oct 26 16:58:23 user nova-compute[75113]:   </metadata>
Oct 26 16:58:23 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:58:23 user nova-compute[75113]:     <system>
Oct 26 16:58:23 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:58:23 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:58:23 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:58:23 user nova-compute[75113]:       <entry name="serial">69ed2396-a603-4c84-a66b-7b474523b68e</entry>
Oct 26 16:58:23 user nova-compute[75113]:       <entry name="uuid">69ed2396-a603-4c84-a66b-7b474523b68e</entry>
Oct 26 16:58:23 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:58:23 user nova-compute[75113]:     </system>
Oct 26 16:58:23 user nova-compute[75113]:   </sysinfo>
Oct 26 16:58:23 user nova-compute[75113]:   <os>
Oct 26 16:58:23 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:58:23 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:58:23 user nova-compute[75113]:   </os>
Oct 26 16:58:23 user nova-compute[75113]:   <features>
Oct 26 16:58:23 user nova-compute[75113]:     <acpi/>
Oct 26 16:58:23 user nova-compute[75113]:     <apic/>
Oct 26 16:58:23 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:58:23 user nova-compute[75113]:   </features>
Oct 26 16:58:23 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:58:23 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:58:23 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:58:23 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:58:23 user nova-compute[75113]:   </clock>
Oct 26 16:58:23 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:58:23 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:58:23 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:58:23 user nova-compute[75113]:   </cpu>
Oct 26 16:58:23 user nova-compute[75113]:   <devices>
Oct 26 16:58:23 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:58:23 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:58:23 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk"/>
Oct 26 16:58:23 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:58:23 user nova-compute[75113]:     </disk>
Oct 26 16:58:23 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 16:58:23 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:58:23 user nova-compute[75113]:       <source dev="/dev/sde"/>
Oct 26 16:58:23 user nova-compute[75113]:       <target dev="vdb" bus="virtio"/>
Oct 26 16:58:23 user nova-compute[75113]:       <serial>80806a8c-ae83-411e-b575-f4ccb122db00</serial>
Oct 26 16:58:23 user nova-compute[75113]:     </disk>
Oct 26 16:58:23 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:58:23 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:58:23 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.rescue"/>
Oct 26 16:58:23 user nova-compute[75113]:       <target dev="vdc" bus="virtio"/>
Oct 26 16:58:23 user nova-compute[75113]:       <boot order="1"/>
Oct 26 16:58:23 user nova-compute[75113]:     </disk>
Oct 26 16:58:23 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:58:23 user nova-compute[75113]:       <mac address="fa:16:3e:bf:13:99"/>
Oct 26 16:58:23 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:58:23 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:58:23 user nova-compute[75113]:       <target dev="tap0502d8bd-66"/>
Oct 26 16:58:23 user nova-compute[75113]:     </interface>
Oct 26 16:58:23 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:58:23 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/console.log" append="off"/>
Oct 26 16:58:23 user nova-compute[75113]:     </serial>
Oct 26 16:58:23 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:58:23 user nova-compute[75113]:     <video>
Oct 26 16:58:23 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:58:23 user nova-compute[75113]:     </video>
Oct 26 16:58:23 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:58:23 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:58:23 user nova-compute[75113]:     </rng>
Oct 26 16:58:23 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:58:23 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:58:23 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:58:23 user nova-compute[75113]:     </memballoon>
Oct 26 16:58:23 user nova-compute[75113]:   </devices>
Oct 26 16:58:23 user nova-compute[75113]: </domain>
Oct 26 16:58:23 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:58:23 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Instance destroyed successfully.
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] No VIF found with MAC fa:16:3e:bf:13:99, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:58:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-26b37104-96e6-49a8-a30d-3a94edb9ff59 req-b162e4a4-4c1c-4b10-b119-4268c278034e service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Received event network-vif-plugged-43ab0866-ca31-415e-bf5c-a5a7cc93f39a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-26b37104-96e6-49a8-a30d-3a94edb9ff59 req-b162e4a4-4c1c-4b10-b119-4268c278034e service nova] Acquiring lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-26b37104-96e6-49a8-a30d-3a94edb9ff59 req-b162e4a4-4c1c-4b10-b119-4268c278034e service nova] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-26b37104-96e6-49a8-a30d-3a94edb9ff59 req-b162e4a4-4c1c-4b10-b119-4268c278034e service nova] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-26b37104-96e6-49a8-a30d-3a94edb9ff59 req-b162e4a4-4c1c-4b10-b119-4268c278034e service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] No waiting events found dispatching network-vif-plugged-43ab0866-ca31-415e-bf5c-a5a7cc93f39a {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:24 user nova-compute[75113]: WARNING nova.compute.manager [req-26b37104-96e6-49a8-a30d-3a94edb9ff59 req-b162e4a4-4c1c-4b10-b119-4268c278034e service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Received unexpected event network-vif-plugged-43ab0866-ca31-415e-bf5c-a5a7cc93f39a for instance with vm_state building and task_state spawning.
Oct 26 16:58:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Acquiring lock "e632e8ad-6d44-4a57-a04b-342bdf513260" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Acquiring lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:24 user nova-compute[75113]: INFO nova.compute.manager [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Terminating instance
Oct 26 16:58:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-858a80b8-2341-4bb7-8fce-85ea1f8e57ab req-6f02fd69-01a5-4ec2-ae6c-605d417f48c4 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Received event network-vif-unplugged-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-858a80b8-2341-4bb7-8fce-85ea1f8e57ab req-6f02fd69-01a5-4ec2-ae6c-605d417f48c4 service nova] Acquiring lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-858a80b8-2341-4bb7-8fce-85ea1f8e57ab req-6f02fd69-01a5-4ec2-ae6c-605d417f48c4 service nova] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-858a80b8-2341-4bb7-8fce-85ea1f8e57ab req-6f02fd69-01a5-4ec2-ae6c-605d417f48c4 service nova] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-858a80b8-2341-4bb7-8fce-85ea1f8e57ab req-6f02fd69-01a5-4ec2-ae6c-605d417f48c4 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] No waiting events found dispatching network-vif-unplugged-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-858a80b8-2341-4bb7-8fce-85ea1f8e57ab req-6f02fd69-01a5-4ec2-ae6c-605d417f48c4 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Received event network-vif-unplugged-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:58:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-4e23f956-0ce3-41cc-b68c-6b47f05fbe6f req-0f08f622-8134-45d6-95c5-e768339352cb service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Received event network-vif-plugged-43ab0866-ca31-415e-bf5c-a5a7cc93f39a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4e23f956-0ce3-41cc-b68c-6b47f05fbe6f req-0f08f622-8134-45d6-95c5-e768339352cb service nova] Acquiring lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4e23f956-0ce3-41cc-b68c-6b47f05fbe6f req-0f08f622-8134-45d6-95c5-e768339352cb service nova] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4e23f956-0ce3-41cc-b68c-6b47f05fbe6f req-0f08f622-8134-45d6-95c5-e768339352cb service nova] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-4e23f956-0ce3-41cc-b68c-6b47f05fbe6f req-0f08f622-8134-45d6-95c5-e768339352cb service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] No waiting events found dispatching network-vif-plugged-43ab0866-ca31-415e-bf5c-a5a7cc93f39a {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:26 user nova-compute[75113]: WARNING nova.compute.manager [req-4e23f956-0ce3-41cc-b68c-6b47f05fbe6f req-0f08f622-8134-45d6-95c5-e768339352cb service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Received unexpected event network-vif-plugged-43ab0866-ca31-415e-bf5c-a5a7cc93f39a for instance with vm_state building and task_state spawning.
Oct 26 16:58:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-813c4d94-c655-4cbc-bcaa-30599f4c7186 req-3fcbdb31-f2c3-478c-ba70-0a414c5d0dc2 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Received event network-vif-plugged-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-813c4d94-c655-4cbc-bcaa-30599f4c7186 req-3fcbdb31-f2c3-478c-ba70-0a414c5d0dc2 service nova] Acquiring lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-813c4d94-c655-4cbc-bcaa-30599f4c7186 req-3fcbdb31-f2c3-478c-ba70-0a414c5d0dc2 service nova] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-813c4d94-c655-4cbc-bcaa-30599f4c7186 req-3fcbdb31-f2c3-478c-ba70-0a414c5d0dc2 service nova] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-813c4d94-c655-4cbc-bcaa-30599f4c7186 req-3fcbdb31-f2c3-478c-ba70-0a414c5d0dc2 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] No waiting events found dispatching network-vif-plugged-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:26 user nova-compute[75113]: WARNING nova.compute.manager [req-813c4d94-c655-4cbc-bcaa-30599f4c7186 req-3fcbdb31-f2c3-478c-ba70-0a414c5d0dc2 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Received unexpected event network-vif-plugged-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 for instance with vm_state active and task_state deleting.
Oct 26 16:58:26 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Instance destroyed successfully.
Oct 26 16:58:26 user nova-compute[75113]: DEBUG nova.objects.instance [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lazy-loading 'resources' on Instance uuid e632e8ad-6d44-4a57-a04b-342bdf513260 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1122499831',display_name='tempest-VolumesAssistedSnapshotsTest-server-1122499831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1122499831',id=7,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG1yqgEOnIi6/+1HsTpcEr2y2lxZUAZCl75aKh3Z38CcSvU1hKv9rzCa+Hpey31wAH9NFI9I2q/PusMMv5xsUyBwTGhEWsVOhJT2ikHcxAEA6L/0cC3E0Qui1fMHOQqEQ==',key_name='tempest-keypair-1150854869',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9154d6bc4a64448cba3150f04e0d5834',ramdisk_id='',reservation_id='r-s7b34hck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1545201126',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1545201126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:54:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1933ebb859b64f4f95374d9ef8948ff0',uuid=e632e8ad-6d44-4a57-a04b-342bdf513260,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "address": "fa:16:3e:8a:01:23", "network": {"id": "36a5fd04-a05e-4e2c-931a-f186ee527b78", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-577328747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154d6bc4a64448cba3150f04e0d5834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb4bd76-9c", "ovs_interfaceid": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Converting VIF {"id": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "address": "fa:16:3e:8a:01:23", "network": {"id": "36a5fd04-a05e-4e2c-931a-f186ee527b78", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-577328747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154d6bc4a64448cba3150f04e0d5834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb4bd76-9c", "ovs_interfaceid": "3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:01:23,bridge_name='br-int',has_traffic_filtering=True,id=3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22,network=Network(36a5fd04-a05e-4e2c-931a-f186ee527b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb4bd76-9c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG os_vif [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:01:23,bridge_name='br-int',has_traffic_filtering=True,id=3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22,network=Network(36a5fd04-a05e-4e2c-931a-f186ee527b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb4bd76-9c') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cb4bd76-9c, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=249c56b4-cfbb-4155-a0c5-088efd3daf21) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:58:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:26 user nova-compute[75113]: INFO os_vif [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:01:23,bridge_name='br-int',has_traffic_filtering=True,id=3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22,network=Network(36a5fd04-a05e-4e2c-931a-f186ee527b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb4bd76-9c')
Oct 26 16:58:26 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Deleting instance files /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260_del
Oct 26 16:58:26 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Deletion of /opt/stack/data/nova/instances/e632e8ad-6d44-4a57-a04b-342bdf513260_del complete
Oct 26 16:58:27 user nova-compute[75113]: INFO nova.compute.manager [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Took 2.71 seconds to destroy the instance on the hypervisor.
Oct 26 16:58:27 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:58:27 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:58:27 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:58:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-070e60f3-ef0a-4e30-810a-d017f65fcb7c req-8903e9f6-330a-46c2-9640-8fbf7b2ffc5b service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Received event network-vif-plugged-de147975-aa0e-4028-af5f-a92993f17b8f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-070e60f3-ef0a-4e30-810a-d017f65fcb7c req-8903e9f6-330a-46c2-9640-8fbf7b2ffc5b service nova] Acquiring lock "04f0351c-6347-4353-bc70-ffa74158496c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-070e60f3-ef0a-4e30-810a-d017f65fcb7c req-8903e9f6-330a-46c2-9640-8fbf7b2ffc5b service nova] Lock "04f0351c-6347-4353-bc70-ffa74158496c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-070e60f3-ef0a-4e30-810a-d017f65fcb7c req-8903e9f6-330a-46c2-9640-8fbf7b2ffc5b service nova] Lock "04f0351c-6347-4353-bc70-ffa74158496c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-070e60f3-ef0a-4e30-810a-d017f65fcb7c req-8903e9f6-330a-46c2-9640-8fbf7b2ffc5b service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] No waiting events found dispatching network-vif-plugged-de147975-aa0e-4028-af5f-a92993f17b8f {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:27 user nova-compute[75113]: WARNING nova.compute.manager [req-070e60f3-ef0a-4e30-810a-d017f65fcb7c req-8903e9f6-330a-46c2-9640-8fbf7b2ffc5b service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Received unexpected event network-vif-plugged-de147975-aa0e-4028-af5f-a92993f17b8f for instance with vm_state building and task_state spawning.
Oct 26 16:58:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:58:28 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Took 1.40 seconds to deallocate network for instance.
Oct 26 16:58:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-c85cf7a1-3c9a-4d74-ba09-9568abc88acf req-8c14ea7e-7ed0-4685-abbc-4e03bf2871aa service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c85cf7a1-3c9a-4d74-ba09-9568abc88acf req-8c14ea7e-7ed0-4685-abbc-4e03bf2871aa service nova] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c85cf7a1-3c9a-4d74-ba09-9568abc88acf req-8c14ea7e-7ed0-4685-abbc-4e03bf2871aa service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c85cf7a1-3c9a-4d74-ba09-9568abc88acf req-8c14ea7e-7ed0-4685-abbc-4e03bf2871aa service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-c85cf7a1-3c9a-4d74-ba09-9568abc88acf req-8c14ea7e-7ed0-4685-abbc-4e03bf2871aa service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] No waiting events found dispatching network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:28 user nova-compute[75113]: WARNING nova.compute.manager [req-c85cf7a1-3c9a-4d74-ba09-9568abc88acf req-8c14ea7e-7ed0-4685-abbc-4e03bf2871aa service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received unexpected event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 for instance with vm_state active and task_state rescuing.
Oct 26 16:58:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-c85cf7a1-3c9a-4d74-ba09-9568abc88acf req-8c14ea7e-7ed0-4685-abbc-4e03bf2871aa service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c85cf7a1-3c9a-4d74-ba09-9568abc88acf req-8c14ea7e-7ed0-4685-abbc-4e03bf2871aa service nova] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c85cf7a1-3c9a-4d74-ba09-9568abc88acf req-8c14ea7e-7ed0-4685-abbc-4e03bf2871aa service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c85cf7a1-3c9a-4d74-ba09-9568abc88acf req-8c14ea7e-7ed0-4685-abbc-4e03bf2871aa service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-c85cf7a1-3c9a-4d74-ba09-9568abc88acf req-8c14ea7e-7ed0-4685-abbc-4e03bf2871aa service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] No waiting events found dispatching network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:28 user nova-compute[75113]: WARNING nova.compute.manager [req-c85cf7a1-3c9a-4d74-ba09-9568abc88acf req-8c14ea7e-7ed0-4685-abbc-4e03bf2871aa service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received unexpected event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 for instance with vm_state active and task_state rescuing.
Oct 26 16:58:28 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:58:28 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:29 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Deleted allocations for instance e632e8ad-6d44-4a57-a04b-342bdf513260
Oct 26 16:58:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-21b2eba9-e8d0-4a69-a314-0e4c02e34c75 tempest-VolumesAssistedSnapshotsTest-1545201126 tempest-VolumesAssistedSnapshotsTest-1545201126-project-member] Lock "e632e8ad-6d44-4a57-a04b-342bdf513260" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.832s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-0c7f4600-eacc-4355-b282-15910061c21b req-251a3f6d-c425-44bd-8bf4-575f361c85e4 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Received event network-vif-plugged-de147975-aa0e-4028-af5f-a92993f17b8f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0c7f4600-eacc-4355-b282-15910061c21b req-251a3f6d-c425-44bd-8bf4-575f361c85e4 service nova] Acquiring lock "04f0351c-6347-4353-bc70-ffa74158496c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0c7f4600-eacc-4355-b282-15910061c21b req-251a3f6d-c425-44bd-8bf4-575f361c85e4 service nova] Lock "04f0351c-6347-4353-bc70-ffa74158496c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0c7f4600-eacc-4355-b282-15910061c21b req-251a3f6d-c425-44bd-8bf4-575f361c85e4 service nova] Lock "04f0351c-6347-4353-bc70-ffa74158496c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-0c7f4600-eacc-4355-b282-15910061c21b req-251a3f6d-c425-44bd-8bf4-575f361c85e4 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] No waiting events found dispatching network-vif-plugged-de147975-aa0e-4028-af5f-a92993f17b8f {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:29 user nova-compute[75113]: WARNING nova.compute.manager [req-0c7f4600-eacc-4355-b282-15910061c21b req-251a3f6d-c425-44bd-8bf4-575f361c85e4 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Received unexpected event network-vif-plugged-de147975-aa0e-4028-af5f-a92993f17b8f for instance with vm_state building and task_state spawning.
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-0c7f4600-eacc-4355-b282-15910061c21b req-251a3f6d-c425-44bd-8bf4-575f361c85e4 service nova] [instance: e632e8ad-6d44-4a57-a04b-342bdf513260] Received event network-vif-deleted-3cb4bd76-9ca3-4bee-a1ec-2ccbe6ad8b22 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:58:29 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Instance spawned successfully.
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:58:29 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Instance spawned successfully.
Oct 26 16:58:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:58:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:58:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:58:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:58:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:58:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:58:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:58:30 user nova-compute[75113]: INFO nova.compute.manager [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Took 10.75 seconds to spawn the instance on the hypervisor.
Oct 26 16:58:30 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:58:30 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9e853c8d-ad99-4654-bbd5-a3e1e359689d tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:58:30 user nova-compute[75113]: INFO nova.compute.manager [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Took 10.01 seconds to spawn the instance on the hypervisor.
Oct 26 16:58:30 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:58:30 user nova-compute[75113]: INFO nova.compute.manager [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Took 11.62 seconds to build instance.
Oct 26 16:58:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4be3bd31-35e8-4ebd-8b0a-da5473df37e1 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.744s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:30 user nova-compute[75113]: INFO nova.compute.manager [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Took 11.59 seconds to build instance.
Oct 26 16:58:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d08654d-8755-4430-96ea-73c9620ba7f0 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "04f0351c-6347-4353-bc70-ffa74158496c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.704s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAOpQCYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:58:33 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:58:33 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:58:33 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab788b45-00ea-43e2-b070-1e53dfaa9af3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:58:33 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8f3377-b025-4211-89d1-466567c3dd6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad] added
Oct 26 16:58:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f927ae75-78dd-4837-8089-f6d347f263d6]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3bd0e0-5f9d-4084-b1b1-4caaec5c9c24]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAOpQCYZ {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAOpQCYZ" returned: 0 in 0.030s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[da55034e-5216-4cbe-8ab3-ccaa9a758a24]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UAOpQCYZ'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76911e4-cb85-477e-a436-b8d919ec8f7c]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcf04d4-d53f-407c-9d62-a730e55e694b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:58:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:58:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6814d70e-5f7a-4fd2-b845-e706a5b3f2ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260]
Oct 26 16:58:33 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260] successful.
Oct 26 16:58:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da06456-d25c-4b10-afd5-a4ad8262405b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcfd3b1-7c05-4aae-99ff-be49d1a05e6e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:58:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:58:33 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:58:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] HCTL ('37', '-', '-', 0) found on session 12 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cb83f2-33a9-4a39-9d5b-84a1b5fd72b0]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:58:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAOpQCYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:58:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:58:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] <== connect_volume: return (1463ms) {'type': 'block', 'scsi_wwn': '23335323038623037', 'path': '/dev/sdf'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:58:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335323038623037', 'path': '/dev/sdf'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:58:34 user nova-compute[75113]: DEBUG nova.objects.instance [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lazy-loading 'flavor' on Instance uuid 645deae0-4c03-41d0-aa3b-daa79ed25425 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:58:35 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:58:35 user nova-compute[75113]:   <source dev="/dev/sdf"/>
Oct 26 16:58:35 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:58:35 user nova-compute[75113]:   <serial>d2af05ff-ba68-4321-b9b9-b5cf9a720bad</serial>
Oct 26 16:58:35 user nova-compute[75113]: </disk>
Oct 26 16:58:35 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:58:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:58:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:58:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] No VIF found with MAC fa:16:3e:0e:ed:4e, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:58:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5956d20c-094f-4feb-b2a2-4468b82e1e2d tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.711s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "9064edf2-de11-4223-baed-d346bfe34fcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:36 user nova-compute[75113]: INFO nova.compute.manager [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Terminating instance
Oct 26 16:58:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-b56aa5ea-f64e-4182-855f-52afebc2d5d7 req-06fa2887-dc47-4d60-9401-ebee047059f1 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-vif-unplugged-b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b56aa5ea-f64e-4182-855f-52afebc2d5d7 req-06fa2887-dc47-4d60-9401-ebee047059f1 service nova] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b56aa5ea-f64e-4182-855f-52afebc2d5d7 req-06fa2887-dc47-4d60-9401-ebee047059f1 service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b56aa5ea-f64e-4182-855f-52afebc2d5d7 req-06fa2887-dc47-4d60-9401-ebee047059f1 service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-b56aa5ea-f64e-4182-855f-52afebc2d5d7 req-06fa2887-dc47-4d60-9401-ebee047059f1 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] No waiting events found dispatching network-vif-unplugged-b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-b56aa5ea-f64e-4182-855f-52afebc2d5d7 req-06fa2887-dc47-4d60-9401-ebee047059f1 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-vif-unplugged-b55efe74-8efe-4e0d-a917-a9c47cae9a85 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:58:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Instance destroyed successfully.
Oct 26 16:58:37 user nova-compute[75113]: DEBUG nova.objects.instance [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lazy-loading 'resources' on Instance uuid 9064edf2-de11-4223-baed-d346bfe34fcc {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1384773775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1384773775',id=8,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESp5K/14Ggl6vrqYPJZwPerrbYDesNlYVE2P8OiIAmeuCFyfagPIf0wDUE44PKomsOLEBGK5zvmXNCoV246gjfXa+oGWMEfMNs4yKfAzQiMGQTrxjH+/YVUO6sO4X+6vw==',key_name='tempest-keypair-1710846497',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87c7a88071a24c96abb06407c59a2775',ramdisk_id='',reservation_id='r-0pxw2si0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-508694228',owner_user_name='tempest-TaggedAttachmentsTest-508694228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3b34c772fc54da89ff6787f12fef797',uuid=9064edf2-de11-4223-baed-d346bfe34fcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converting VIF {"id": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "address": "fa:16:3e:84:a4:ac", "network": {"id": "c860b8a4-ed0c-4f6a-b072-db46ec3a9d61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1816757323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c7a88071a24c96abb06407c59a2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55efe74-8e", "ovs_interfaceid": "b55efe74-8efe-4e0d-a917-a9c47cae9a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:a4:ac,bridge_name='br-int',has_traffic_filtering=True,id=b55efe74-8efe-4e0d-a917-a9c47cae9a85,network=Network(c860b8a4-ed0c-4f6a-b072-db46ec3a9d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55efe74-8e') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG os_vif [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:a4:ac,bridge_name='br-int',has_traffic_filtering=True,id=b55efe74-8efe-4e0d-a917-a9c47cae9a85,network=Network(c860b8a4-ed0c-4f6a-b072-db46ec3a9d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55efe74-8e') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb55efe74-8e, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c614884-c222-47a6-9b3e-861fc7170ca7) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:37 user nova-compute[75113]: INFO os_vif [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:a4:ac,bridge_name='br-int',has_traffic_filtering=True,id=b55efe74-8efe-4e0d-a917-a9c47cae9a85,network=Network(c860b8a4-ed0c-4f6a-b072-db46ec3a9d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55efe74-8e')
Oct 26 16:58:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Deleting instance files /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc_del
Oct 26 16:58:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Deletion of /opt/stack/data/nova/instances/9064edf2-de11-4223-baed-d346bfe34fcc_del complete
Oct 26 16:58:37 user nova-compute[75113]: INFO nova.compute.manager [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 26 16:58:37 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:58:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Stashing vm_state: active {{(pid=75113) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 26 16:58:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:58:38 user nova-compute[75113]: INFO nova.compute.claims [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Claim successful on node user
Oct 26 16:58:38 user nova-compute[75113]: INFO nova.compute.resource_tracker [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating resource usage from migration 54b08be3-ea1f-483d-af4a-b0502177fae0
Oct 26 16:58:38 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:58:38 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:58:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.489s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:38 user nova-compute[75113]: INFO nova.compute.manager [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Migrating
Oct 26 16:58:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:58:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:58:38 user nova-compute[75113]: INFO nova.compute.rpcapi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 26 16:58:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:58:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:58:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquired lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:58:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:58:38 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:58:38 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Took 1.34 seconds to deallocate network for instance.
Oct 26 16:58:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-b002a031-8024-44f4-b9bd-05523d00c4a2 req-b232a381-0451-4311-baba-fa77fa1d9869 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-vif-deleted-b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:38 user nova-compute[75113]: INFO nova.compute.manager [req-b002a031-8024-44f4-b9bd-05523d00c4a2 req-b232a381-0451-4311-baba-fa77fa1d9869 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Neutron deleted interface b55efe74-8efe-4e0d-a917-a9c47cae9a85; detaching it from the instance and deleting it from the info cache
Oct 26 16:58:38 user nova-compute[75113]: DEBUG nova.network.neutron [req-b002a031-8024-44f4-b9bd-05523d00c4a2 req-b232a381-0451-4311-baba-fa77fa1d9869 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:58:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-b002a031-8024-44f4-b9bd-05523d00c4a2 req-b232a381-0451-4311-baba-fa77fa1d9869 service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Detach interface failed, port_id=b55efe74-8efe-4e0d-a917-a9c47cae9a85, reason: Instance 9064edf2-de11-4223-baed-d346bfe34fcc could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 16:58:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-d1c002c2-7012-40aa-9d1e-f8776b1b9a9c req-2f95fb9b-21fa-4ecc-99a2-28fbc4ff710f service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received event network-vif-plugged-b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1c002c2-7012-40aa-9d1e-f8776b1b9a9c req-2f95fb9b-21fa-4ecc-99a2-28fbc4ff710f service nova] Acquiring lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1c002c2-7012-40aa-9d1e-f8776b1b9a9c req-2f95fb9b-21fa-4ecc-99a2-28fbc4ff710f service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1c002c2-7012-40aa-9d1e-f8776b1b9a9c req-2f95fb9b-21fa-4ecc-99a2-28fbc4ff710f service nova] Lock "9064edf2-de11-4223-baed-d346bfe34fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-d1c002c2-7012-40aa-9d1e-f8776b1b9a9c req-2f95fb9b-21fa-4ecc-99a2-28fbc4ff710f service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] No waiting events found dispatching network-vif-plugged-b55efe74-8efe-4e0d-a917-a9c47cae9a85 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:39 user nova-compute[75113]: WARNING nova.compute.manager [req-d1c002c2-7012-40aa-9d1e-f8776b1b9a9c req-2f95fb9b-21fa-4ecc-99a2-28fbc4ff710f service nova] [instance: 9064edf2-de11-4223-baed-d346bfe34fcc] Received unexpected event network-vif-plugged-b55efe74-8efe-4e0d-a917-a9c47cae9a85 for instance with vm_state deleted and task_state None.
Oct 26 16:58:39 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating instance_info_cache with network_info: [{"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Releasing lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Starting migrate_disk_and_power_off {{(pid=75113) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 26 16:58:39 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Deleted allocations for instance 9064edf2-de11-4223-baed-d346bfe34fcc
Oct 26 16:58:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7e348493-3d73-4ad0-85ea-aa4d3ebb34de tempest-TaggedAttachmentsTest-508694228 tempest-TaggedAttachmentsTest-508694228-project-member] Lock "9064edf2-de11-4223-baed-d346bfe34fcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.077s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:40 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Instance destroyed successfully.
Oct 26 16:58:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1163194343',display_name='tempest-ServerActionsTestOtherB-server-1163194343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1163194343',id=2,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNi6S0kdc5pWvhxq2azP5QRonb6qXMUiteND1nfP3Uf2jZWYfGzWg8fbqOsk4PAj062T9NqyLIEevO2i2GpMs0q5myp5A+SX7ogwodc86c3yyzOTm1sjFsenkun5EW0fg==',key_name='tempest-keypair-1305775717',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='992a6be3e5814c3b80c705763af5de1e',ramdisk_id='',reservation_id='r-fvz5sf1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1008157220',owner_user_name='tempest-ServerActionsTestOtherB-1008157220-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:58:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f45ddba3b44d1b9333b282e43b02e8',uuid=645deae0-4c03-41d0-aa3b-daa79ed25425,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-918986316-network", "vif_mac": "fa:16:3e:0e:ed:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converting VIF {"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-918986316-network", "vif_mac": "fa:16:3e:0e:ed:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_vif [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96d708f7-00, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c930e16-dfa4-41a6-bd64-b19f344da0ce) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:40 user nova-compute[75113]: INFO os_vif [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00')
Oct 26 16:58:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAOpQCYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:58:40 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9790a8-8682-4978-9922-db73f486d3b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:58:40 user nova-compute[75113]: No targets found.
Oct 26 16:58:40 user nova-compute[75113]: iSNS:
Oct 26 16:58:40 user nova-compute[75113]: No targets found.
Oct 26 16:58:40 user nova-compute[75113]: STATIC:
Oct 26 16:58:40 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac
Oct 26 16:58:40 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:58:40 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:58:40 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f
Oct 26 16:58:40 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:58:40 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:58:40 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7
Oct 26 16:58:40 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:58:40 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:58:40 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08
Oct 26 16:58:40 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:58:40 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:58:40 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad
Oct 26 16:58:40 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:58:40 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:58:40 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00
Oct 26 16:58:40 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:58:40 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:58:40 user nova-compute[75113]: FIRMWARE:
Oct 26 16:58:40 user nova-compute[75113]: No targets found.
Oct 26 16:58:40 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:58:40 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:58:40 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaff16c-0078-4a4c-8aa4-5d499de87363]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[87085f17-1fbe-4840-8bac-2cceec5a144f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:58:40 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:58:40 user nova-compute[75113]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:58:40 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:58:40 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:58:40 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:58:40 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:58:40 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:58:40 user nova-compute[75113]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:58:40 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:58:40 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:58:40 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:58:40 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49143bc310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad'): ({'sdf'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Removing single pathed devices sdf {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[99879149-6750-4e01-a683-e2541564cef9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01940cd-7e93-463a-9acd-042898d97bdb]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Flushing IO for device /dev/sdf {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e6781f-e52f-4516-bdd8-5aa21264d009]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fab438f-3cc8-4c05-afb2-fa82edba6609]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] SCSI volumes sdf have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b99110e-e212-45e6-a515-4cee5dc17982]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a073bfb9-6c38-4e03-96ff-fb7a4c6fd352]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260]
Oct 26 16:58:40 user nova-compute[75113]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260] successful.
Oct 26 16:58:40 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffe12e2-0533-4014-9299-4a86a80db499]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] <== disconnect_volume: return (379ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3e91c6e-f962-4ce9-a56a-8f01126603ef req-46341cfd-792c-45bb-9772-7e36c43c17e0 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-unplugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3e91c6e-f962-4ce9-a56a-8f01126603ef req-46341cfd-792c-45bb-9772-7e36c43c17e0 service nova] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3e91c6e-f962-4ce9-a56a-8f01126603ef req-46341cfd-792c-45bb-9772-7e36c43c17e0 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3e91c6e-f962-4ce9-a56a-8f01126603ef req-46341cfd-792c-45bb-9772-7e36c43c17e0 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3e91c6e-f962-4ce9-a56a-8f01126603ef req-46341cfd-792c-45bb-9772-7e36c43c17e0 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] No waiting events found dispatching network-vif-unplugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:41 user nova-compute[75113]: WARNING nova.compute.manager [req-e3e91c6e-f962-4ce9-a56a-8f01126603ef req-46341cfd-792c-45bb-9772-7e36c43c17e0 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received unexpected event network-vif-unplugged-96d708f7-00f7-44af-9bc6-43882921ea03 for instance with vm_state active and task_state resize_migrating.
Oct 26 16:58:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3e91c6e-f962-4ce9-a56a-8f01126603ef req-46341cfd-792c-45bb-9772-7e36c43c17e0 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3e91c6e-f962-4ce9-a56a-8f01126603ef req-46341cfd-792c-45bb-9772-7e36c43c17e0 service nova] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3e91c6e-f962-4ce9-a56a-8f01126603ef req-46341cfd-792c-45bb-9772-7e36c43c17e0 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3e91c6e-f962-4ce9-a56a-8f01126603ef req-46341cfd-792c-45bb-9772-7e36c43c17e0 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3e91c6e-f962-4ce9-a56a-8f01126603ef req-46341cfd-792c-45bb-9772-7e36c43c17e0 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] No waiting events found dispatching network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:58:41 user nova-compute[75113]: WARNING nova.compute.manager [req-e3e91c6e-f962-4ce9-a56a-8f01126603ef req-46341cfd-792c-45bb-9772-7e36c43c17e0 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received unexpected event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 for instance with vm_state active and task_state resize_migrating.
Oct 26 16:58:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425_resize/disk /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CMD "cp -r /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425_resize/disk /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk" returned: 0 in 0.337s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425_resize/disk.info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk.info {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CMD "cp -r /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425_resize/disk.info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk.info" returned: 0 in 0.030s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:42 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Port 96d708f7-00f7-44af-9bc6-43882921ea03 binding to destination host user is already ACTIVE {{(pid=75113) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 16:58:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:58:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:58:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:58:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:58:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquired lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:58:43 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:58:43 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating instance_info_cache with network_info: [{"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Releasing lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG os_brick.utils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f35477-1d92-4eaf-88be-70e0d5eb51e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.037s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ad0bce-b196-4d92-a2aa-d98f3cf25550]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57489fbf-211c-4360-b05f-876c0370a349]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[90afe0e2-1b08-4549-b859-7780a6b8f765]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:58:44 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:58:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bf28ae-6d6a-4472-b31c-46a867eb708c]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:58:44 user nova-compute[75113]: DEBUG os_brick.utils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:58:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:54 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:58:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:58:58 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:58:58 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:58:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-fbf1e605-91c5-4188-9081-f9762ad92a9f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:58:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-fbf1e605-91c5-4188-9081-f9762ad92a9f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:58:58 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:58:58 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Updating instance_info_cache with network_info: [{"id": "02278050-c73c-493a-83c4-095f43697e9f", "address": "fa:16:3e:dc:3d:4b", "network": {"id": "04d9fbd9-4ccd-424a-ac46-2324eac68387", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1918515909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee6a73f02e54d7fa20bbe92d986f577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02278050-c7", "ovs_interfaceid": "02278050-c73c-493a-83c4-095f43697e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:58:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-fbf1e605-91c5-4188-9081-f9762ad92a9f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:58:58 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:58:58 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:58:59 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:58:59 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:58:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:59:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:59:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:00 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:59:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:59:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:59:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:04 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:59:04 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7481MB free_disk=25.326801300048828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Applying migration context for instance 645deae0-4c03-41d0-aa3b-daa79ed25425 as it has an incoming, in-progress migration 54b08be3-ea1f-483d-af4a-b0502177fae0. Migration status is post-migrating {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 16:59:04 user nova-compute[75113]: INFO nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating resource usage from migration 54b08be3-ea1f-483d-af4a-b0502177fae0
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 69ed2396-a603-4c84-a66b-7b474523b68e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance f1769d95-897b-4e83-89ba-c486aa086dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fbf1e605-91c5-4188-9081-f9762ad92a9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance a8368686-8c4d-4373-a3a5-4498e2086e0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 8d18f293-ebac-4392-9405-869a7e23f3e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance cafa9881-242a-4275-8125-80f415d56ee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 413deca1-2056-455a-b7c6-e0730ea1a57e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Migration 54b08be3-ea1f-483d-af4a-b0502177fae0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 645deae0-4c03-41d0-aa3b-daa79ed25425 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:59:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:59:05 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:59:05 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:59:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:59:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Starting finish_migration {{(pid=75113) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Instance directory exists: not creating {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 16:59:06 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Creating image(s)
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.180s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Checking if we can resize image /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk. size=21474836480 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk 21474836480 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk 21474836480" returned: 0 in 0.042s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Ensure instance console log exists: /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Start _get_guest_xml network_info=[{"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-918986316-network", "vif_mac": "fa:16:3e:0e:ed:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8851c1d8-73e8-4a13-9f49-fea8ea41dcf8', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAOpQCYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '645deae0-4c03-41d0-aa3b-daa79ed25425', 'attached_at': '2023-10-26T16:59:06.000000', 'detached_at': '', 'volume_id': 'd2af05ff-ba68-4321-b9b9-b5cf9a720bad', 'serial': 'd2af05ff-ba68-4321-b9b9-b5cf9a720bad'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:59:06 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:59:06 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAOpQCYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:59:06 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:59:06 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:59:06 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[09768c8c-a44a-4349-a694-9bd619d359f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:59:06 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[758f5bba-f56c-4571-bd8a-1e8c66998c13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad] added
Oct 26 16:59:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1781815d-a5bf-4a9b-a8b4-c8b9c8c68858]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[be337ca7-e930-46fe-bff7-c9f6b8a42bd5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAOpQCYZ {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAOpQCYZ" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[45afeff7-6977-47d5-a87a-948171b153ce]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UAOpQCYZ'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4ee54c-3989-4b9a-95ca-38f3638f6e89]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57c68b8-4490-4bc8-aae5-0fb81747091e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:59:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:59:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[512a51e4-d90e-4d06-8a86-af099120e301]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260]
Oct 26 16:59:06 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260] successful.
Oct 26 16:59:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[71858051-a2eb-4840-9e9f-d7e352c9114b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d2492e-3d7b-41a1-8040-9dfc8424eb60]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:59:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:59:06 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:59:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcf198f-de28-4a05-a7e0-fcd3fa819f2a]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAOpQCYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:59:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23335323038623037', 'path': '/dev/sdf'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335323038623037', 'path': '/dev/sdf'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1163194343',display_name='tempest-ServerActionsTestOtherB-server-1163194343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1163194343',id=2,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNi6S0kdc5pWvhxq2azP5QRonb6qXMUiteND1nfP3Uf2jZWYfGzWg8fbqOsk4PAj062T9NqyLIEevO2i2GpMs0q5myp5A+SX7ogwodc86c3yyzOTm1sjFsenkun5EW0fg==',key_name='tempest-keypair-1305775717',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='992a6be3e5814c3b80c705763af5de1e',ramdisk_id='',reservation_id='r-fvz5sf1r',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1008157220',owner_user_name='tempest-ServerActionsTestOtherB-1008157220-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:58:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f45ddba3b44d1b9333b282e43b02e8',uuid=645deae0-4c03-41d0-aa3b-daa79ed25425,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-918986316-network", "vif_mac": "fa:16:3e:0e:ed:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converting VIF {"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-918986316-network", "vif_mac": "fa:16:3e:0e:ed:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:59:07 user nova-compute[75113]:   <uuid>645deae0-4c03-41d0-aa3b-daa79ed25425</uuid>
Oct 26 16:59:07 user nova-compute[75113]:   <name>instance-00000002</name>
Oct 26 16:59:07 user nova-compute[75113]:   <memory>2097152</memory>
Oct 26 16:59:07 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:59:07 user nova-compute[75113]:   <metadata>
Oct 26 16:59:07 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:59:07 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:59:07 user nova-compute[75113]:       <nova:name>tempest-ServerActionsTestOtherB-server-1163194343</nova:name>
Oct 26 16:59:07 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:59:06</nova:creationTime>
Oct 26 16:59:07 user nova-compute[75113]:       <nova:flavor name="m1.small">
Oct 26 16:59:07 user nova-compute[75113]:         <nova:memory>2048</nova:memory>
Oct 26 16:59:07 user nova-compute[75113]:         <nova:disk>20</nova:disk>
Oct 26 16:59:07 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:59:07 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:59:07 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:59:07 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:59:07 user nova-compute[75113]:       <nova:owner>
Oct 26 16:59:07 user nova-compute[75113]:         <nova:user uuid="38f45ddba3b44d1b9333b282e43b02e8">tempest-ServerActionsTestOtherB-1008157220-project-member</nova:user>
Oct 26 16:59:07 user nova-compute[75113]:         <nova:project uuid="992a6be3e5814c3b80c705763af5de1e">tempest-ServerActionsTestOtherB-1008157220</nova:project>
Oct 26 16:59:07 user nova-compute[75113]:       </nova:owner>
Oct 26 16:59:07 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:59:07 user nova-compute[75113]:       <nova:ports>
Oct 26 16:59:07 user nova-compute[75113]:         <nova:port uuid="96d708f7-00f7-44af-9bc6-43882921ea03">
Oct 26 16:59:07 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 16:59:07 user nova-compute[75113]:         </nova:port>
Oct 26 16:59:07 user nova-compute[75113]:       </nova:ports>
Oct 26 16:59:07 user nova-compute[75113]:     </nova:instance>
Oct 26 16:59:07 user nova-compute[75113]:   </metadata>
Oct 26 16:59:07 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:59:07 user nova-compute[75113]:     <system>
Oct 26 16:59:07 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:59:07 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:59:07 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:59:07 user nova-compute[75113]:       <entry name="serial">645deae0-4c03-41d0-aa3b-daa79ed25425</entry>
Oct 26 16:59:07 user nova-compute[75113]:       <entry name="uuid">645deae0-4c03-41d0-aa3b-daa79ed25425</entry>
Oct 26 16:59:07 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:59:07 user nova-compute[75113]:     </system>
Oct 26 16:59:07 user nova-compute[75113]:   </sysinfo>
Oct 26 16:59:07 user nova-compute[75113]:   <os>
Oct 26 16:59:07 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:59:07 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:59:07 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:59:07 user nova-compute[75113]:   </os>
Oct 26 16:59:07 user nova-compute[75113]:   <features>
Oct 26 16:59:07 user nova-compute[75113]:     <acpi/>
Oct 26 16:59:07 user nova-compute[75113]:     <apic/>
Oct 26 16:59:07 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:59:07 user nova-compute[75113]:   </features>
Oct 26 16:59:07 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:59:07 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:59:07 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:59:07 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:59:07 user nova-compute[75113]:   </clock>
Oct 26 16:59:07 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:59:07 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:59:07 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:59:07 user nova-compute[75113]:   </cpu>
Oct 26 16:59:07 user nova-compute[75113]:   <devices>
Oct 26 16:59:07 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:59:07 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:59:07 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk"/>
Oct 26 16:59:07 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:59:07 user nova-compute[75113]:     </disk>
Oct 26 16:59:07 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 16:59:07 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:59:07 user nova-compute[75113]:       <source dev="/dev/sdf"/>
Oct 26 16:59:07 user nova-compute[75113]:       <target dev="vdb" bus="virtio"/>
Oct 26 16:59:07 user nova-compute[75113]:       <serial>d2af05ff-ba68-4321-b9b9-b5cf9a720bad</serial>
Oct 26 16:59:07 user nova-compute[75113]:     </disk>
Oct 26 16:59:07 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:59:07 user nova-compute[75113]:       <mac address="fa:16:3e:0e:ed:4e"/>
Oct 26 16:59:07 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:59:07 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:59:07 user nova-compute[75113]:       <target dev="tap96d708f7-00"/>
Oct 26 16:59:07 user nova-compute[75113]:     </interface>
Oct 26 16:59:07 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:59:07 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/console.log" append="off"/>
Oct 26 16:59:07 user nova-compute[75113]:     </serial>
Oct 26 16:59:07 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:59:07 user nova-compute[75113]:     <video>
Oct 26 16:59:07 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:59:07 user nova-compute[75113]:     </video>
Oct 26 16:59:07 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:59:07 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:59:07 user nova-compute[75113]:     </rng>
Oct 26 16:59:07 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:59:07 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:59:07 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:59:07 user nova-compute[75113]:     </memballoon>
Oct 26 16:59:07 user nova-compute[75113]:   </devices>
Oct 26 16:59:07 user nova-compute[75113]: </domain>
Oct 26 16:59:07 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1163194343',display_name='tempest-ServerActionsTestOtherB-server-1163194343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1163194343',id=2,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNi6S0kdc5pWvhxq2azP5QRonb6qXMUiteND1nfP3Uf2jZWYfGzWg8fbqOsk4PAj062T9NqyLIEevO2i2GpMs0q5myp5A+SX7ogwodc86c3yyzOTm1sjFsenkun5EW0fg==',key_name='tempest-keypair-1305775717',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='992a6be3e5814c3b80c705763af5de1e',ramdisk_id='',reservation_id='r-fvz5sf1r',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1008157220',owner_user_name='tempest-ServerActionsTestOtherB-1008157220-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:58:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f45ddba3b44d1b9333b282e43b02e8',uuid=645deae0-4c03-41d0-aa3b-daa79ed25425,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-918986316-network", "vif_mac": "fa:16:3e:0e:ed:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converting VIF {"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-918986316-network", "vif_mac": "fa:16:3e:0e:ed:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG os_vif [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac662543-30ce-5fd8-bd5e-0ffbbb41a931', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96d708f7-00, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96d708f7-00, col_values=(('qos', UUID('bfdc2bbc-e875-44aa-be57-b4716c30f692')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96d708f7-00, col_values=(('external_ids', {'iface-id': '96d708f7-00f7-44af-9bc6-43882921ea03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:ed:4e', 'vm-uuid': '645deae0-4c03-41d0-aa3b-daa79ed25425'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:07 user nova-compute[75113]: INFO os_vif [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00')
Oct 26 16:59:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:59:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:59:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] No VIF found with MAC fa:16:3e:0e:ed:4e, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:59:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:11 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:59:11 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Instance running successfully.
Oct 26 16:59:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Failed to set time: agent not configured {{(pid=75113) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 26 16:59:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3b529b00-567b-4142-9b96-4f5151cbfa2a tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] finish_migration finished successfully. {{(pid=75113) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "ff2781bd-106d-4cdb-844c-41c58a191a88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:59:12 user nova-compute[75113]: INFO nova.compute.claims [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Claim successful on node user
Oct 26 16:59:12 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG nova.network.neutron [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:59:12 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:59:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG nova.policy [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be611f9c83184dc29d232904a828b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e63bbd8ed7e4fc189d54c828d43e445', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:59:12 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Creating image(s)
Oct 26 16:59:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "/opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "/opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.030s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.215s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk 1073741824" returned: 0 in 0.063s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG nova.network.neutron [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Successfully created port: a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG nova.compute.manager [req-c665117d-40fc-462a-909b-e417fb92b60c req-f912482f-d66f-43cf-9974-ac5f73516304 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Received event network-changed-c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG nova.compute.manager [req-c665117d-40fc-462a-909b-e417fb92b60c req-f912482f-d66f-43cf-9974-ac5f73516304 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Refreshing instance network info cache due to event network-changed-c7b6c1aa-2d23-4be9-add7-b54f42557d05. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c665117d-40fc-462a-909b-e417fb92b60c req-f912482f-d66f-43cf-9974-ac5f73516304 service nova] Acquiring lock "refresh_cache-cafa9881-242a-4275-8125-80f415d56ee8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c665117d-40fc-462a-909b-e417fb92b60c req-f912482f-d66f-43cf-9974-ac5f73516304 service nova] Acquired lock "refresh_cache-cafa9881-242a-4275-8125-80f415d56ee8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG nova.network.neutron [req-c665117d-40fc-462a-909b-e417fb92b60c req-f912482f-d66f-43cf-9974-ac5f73516304 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Refreshing network info cache for port c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.204s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Cannot resize image /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Ensure instance console log exists: /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.network.neutron [req-c665117d-40fc-462a-909b-e417fb92b60c req-f912482f-d66f-43cf-9974-ac5f73516304 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Updated VIF entry in instance network info cache for port c7b6c1aa-2d23-4be9-add7-b54f42557d05. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.network.neutron [req-c665117d-40fc-462a-909b-e417fb92b60c req-f912482f-d66f-43cf-9974-ac5f73516304 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Updating instance_info_cache with network_info: [{"id": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "address": "fa:16:3e:fd:e6:f5", "network": {"id": "2fb896f7-d8a7-49a5-a9ee-90da1afff111", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-610632337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f527bb82a1c45f08faded8f87750026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b6c1aa-2d", "ovs_interfaceid": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c665117d-40fc-462a-909b-e417fb92b60c req-f912482f-d66f-43cf-9974-ac5f73516304 service nova] Releasing lock "refresh_cache-cafa9881-242a-4275-8125-80f415d56ee8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Successfully updated port: a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquired lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-505a7ffc-1803-4521-8600-3e7709a63da8 req-d8fba4b5-91fa-439b-8327-25aca6dbb19a service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Received event network-changed-a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-505a7ffc-1803-4521-8600-3e7709a63da8 req-d8fba4b5-91fa-439b-8327-25aca6dbb19a service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Refreshing instance network info cache due to event network-changed-a1aedd8d-1f49-4949-9e8e-d1800971fd0f. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-505a7ffc-1803-4521-8600-3e7709a63da8 req-d8fba4b5-91fa-439b-8327-25aca6dbb19a service nova] Acquiring lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updating instance_info_cache with network_info: [{"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Releasing lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Instance network_info: |[{"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-505a7ffc-1803-4521-8600-3e7709a63da8 req-d8fba4b5-91fa-439b-8327-25aca6dbb19a service nova] Acquired lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.network.neutron [req-505a7ffc-1803-4521-8600-3e7709a63da8 req-d8fba4b5-91fa-439b-8327-25aca6dbb19a service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Refreshing network info cache for port a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Start _get_guest_xml network_info=[{"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:59:14 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:59:14 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1243004183',display_name='tempest-ServerActionsTestOtherA-server-1243004183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1243004183',id=14,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJUID7/sgaW7v1qEz5yD7qPGwhwC+8ZuDRQIBbpLrTvyGuQpgvdE4GCh2rNno39iufUQMngc4uPWtbJQKyjANVZtkRT2aaUI7mWC3EKIsR7qjErlpC+wkdFBgM3eTSeRw==',key_name='tempest-keypair-536776118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-5d1526no',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:59:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=ff2781bd-106d-4cdb-844c-41c58a191a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a1aedd8d-1f49-4949-9e8e-d1800971fd0f,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1aedd8d-1f') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.objects.instance [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lazy-loading 'pci_devices' on Instance uuid ff2781bd-106d-4cdb-844c-41c58a191a88 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:59:14 user nova-compute[75113]:   <uuid>ff2781bd-106d-4cdb-844c-41c58a191a88</uuid>
Oct 26 16:59:14 user nova-compute[75113]:   <name>instance-0000000e</name>
Oct 26 16:59:14 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:59:14 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:59:14 user nova-compute[75113]:   <metadata>
Oct 26 16:59:14 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:59:14 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:59:14 user nova-compute[75113]:       <nova:name>tempest-ServerActionsTestOtherA-server-1243004183</nova:name>
Oct 26 16:59:14 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:59:14</nova:creationTime>
Oct 26 16:59:14 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:59:14 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:59:14 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:59:14 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:59:14 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:59:14 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:59:14 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:59:14 user nova-compute[75113]:       <nova:owner>
Oct 26 16:59:14 user nova-compute[75113]:         <nova:user uuid="be611f9c83184dc29d232904a828b12a">tempest-ServerActionsTestOtherA-2074512325-project-member</nova:user>
Oct 26 16:59:14 user nova-compute[75113]:         <nova:project uuid="5e63bbd8ed7e4fc189d54c828d43e445">tempest-ServerActionsTestOtherA-2074512325</nova:project>
Oct 26 16:59:14 user nova-compute[75113]:       </nova:owner>
Oct 26 16:59:14 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 16:59:14 user nova-compute[75113]:       <nova:ports>
Oct 26 16:59:14 user nova-compute[75113]:         <nova:port uuid="a1aedd8d-1f49-4949-9e8e-d1800971fd0f">
Oct 26 16:59:14 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 16:59:14 user nova-compute[75113]:         </nova:port>
Oct 26 16:59:14 user nova-compute[75113]:       </nova:ports>
Oct 26 16:59:14 user nova-compute[75113]:     </nova:instance>
Oct 26 16:59:14 user nova-compute[75113]:   </metadata>
Oct 26 16:59:14 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:59:14 user nova-compute[75113]:     <system>
Oct 26 16:59:14 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:59:14 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:59:14 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:59:14 user nova-compute[75113]:       <entry name="serial">ff2781bd-106d-4cdb-844c-41c58a191a88</entry>
Oct 26 16:59:14 user nova-compute[75113]:       <entry name="uuid">ff2781bd-106d-4cdb-844c-41c58a191a88</entry>
Oct 26 16:59:14 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:59:14 user nova-compute[75113]:     </system>
Oct 26 16:59:14 user nova-compute[75113]:   </sysinfo>
Oct 26 16:59:14 user nova-compute[75113]:   <os>
Oct 26 16:59:14 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:59:14 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:59:14 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:59:14 user nova-compute[75113]:   </os>
Oct 26 16:59:14 user nova-compute[75113]:   <features>
Oct 26 16:59:14 user nova-compute[75113]:     <acpi/>
Oct 26 16:59:14 user nova-compute[75113]:     <apic/>
Oct 26 16:59:14 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:59:14 user nova-compute[75113]:   </features>
Oct 26 16:59:14 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:59:14 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:59:14 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:59:14 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:59:14 user nova-compute[75113]:   </clock>
Oct 26 16:59:14 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:59:14 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:59:14 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:59:14 user nova-compute[75113]:   </cpu>
Oct 26 16:59:14 user nova-compute[75113]:   <devices>
Oct 26 16:59:14 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:59:14 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:59:14 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk"/>
Oct 26 16:59:14 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:59:14 user nova-compute[75113]:     </disk>
Oct 26 16:59:14 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:59:14 user nova-compute[75113]:       <mac address="fa:16:3e:94:28:0d"/>
Oct 26 16:59:14 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:59:14 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:59:14 user nova-compute[75113]:       <target dev="tapa1aedd8d-1f"/>
Oct 26 16:59:14 user nova-compute[75113]:     </interface>
Oct 26 16:59:14 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:59:14 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/console.log" append="off"/>
Oct 26 16:59:14 user nova-compute[75113]:     </serial>
Oct 26 16:59:14 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:59:14 user nova-compute[75113]:     <video>
Oct 26 16:59:14 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:59:14 user nova-compute[75113]:     </video>
Oct 26 16:59:14 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:59:14 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:59:14 user nova-compute[75113]:     </rng>
Oct 26 16:59:14 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:59:14 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:59:14 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:59:14 user nova-compute[75113]:     </memballoon>
Oct 26 16:59:14 user nova-compute[75113]:   </devices>
Oct 26 16:59:14 user nova-compute[75113]: </domain>
Oct 26 16:59:14 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1243004183',display_name='tempest-ServerActionsTestOtherA-server-1243004183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1243004183',id=14,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJUID7/sgaW7v1qEz5yD7qPGwhwC+8ZuDRQIBbpLrTvyGuQpgvdE4GCh2rNno39iufUQMngc4uPWtbJQKyjANVZtkRT2aaUI7mWC3EKIsR7qjErlpC+wkdFBgM3eTSeRw==',key_name='tempest-keypair-536776118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-5d1526no',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:59:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=ff2781bd-106d-4cdb-844c-41c58a191a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a1aedd8d-1f49-4949-9e8e-d1800971fd0f,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1aedd8d-1f') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG os_vif [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a1aedd8d-1f49-4949-9e8e-d1800971fd0f,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1aedd8d-1f') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e9f2e3d-0479-5086-b6ad-bad0bc7ad852', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1aedd8d-1f, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1aedd8d-1f, col_values=(('qos', UUID('7c2f1c10-6cd5-4f38-9e40-9fcf40b9e747')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1aedd8d-1f, col_values=(('external_ids', {'iface-id': 'a1aedd8d-1f49-4949-9e8e-d1800971fd0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:28:0d', 'vm-uuid': 'ff2781bd-106d-4cdb-844c-41c58a191a88'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:14 user nova-compute[75113]: INFO os_vif [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a1aedd8d-1f49-4949-9e8e-d1800971fd0f,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1aedd8d-1f')
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:59:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No VIF found with MAC fa:16:3e:94:28:0d, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:59:15 user nova-compute[75113]: DEBUG nova.network.neutron [req-505a7ffc-1803-4521-8600-3e7709a63da8 req-d8fba4b5-91fa-439b-8327-25aca6dbb19a service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updated VIF entry in instance network info cache for port a1aedd8d-1f49-4949-9e8e-d1800971fd0f. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:59:15 user nova-compute[75113]: DEBUG nova.network.neutron [req-505a7ffc-1803-4521-8600-3e7709a63da8 req-d8fba4b5-91fa-439b-8327-25aca6dbb19a service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updating instance_info_cache with network_info: [{"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:59:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-505a7ffc-1803-4521-8600-3e7709a63da8 req-d8fba4b5-91fa-439b-8327-25aca6dbb19a service nova] Releasing lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:59:15 user nova-compute[75113]: DEBUG nova.compute.manager [req-2b4a1a60-a404-41f5-a7c9-d398e50bd0ad req-de510aff-5ac4-43ef-89d3-96807f1c0eff service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b4a1a60-a404-41f5-a7c9-d398e50bd0ad req-de510aff-5ac4-43ef-89d3-96807f1c0eff service nova] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b4a1a60-a404-41f5-a7c9-d398e50bd0ad req-de510aff-5ac4-43ef-89d3-96807f1c0eff service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b4a1a60-a404-41f5-a7c9-d398e50bd0ad req-de510aff-5ac4-43ef-89d3-96807f1c0eff service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:15 user nova-compute[75113]: DEBUG nova.compute.manager [req-2b4a1a60-a404-41f5-a7c9-d398e50bd0ad req-de510aff-5ac4-43ef-89d3-96807f1c0eff service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] No waiting events found dispatching network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:15 user nova-compute[75113]: WARNING nova.compute.manager [req-2b4a1a60-a404-41f5-a7c9-d398e50bd0ad req-de510aff-5ac4-43ef-89d3-96807f1c0eff service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received unexpected event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 for instance with vm_state resized and task_state None.
Oct 26 16:59:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:15 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:59:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:15 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:59:15 user nova-compute[75113]: INFO nova.compute.claims [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Claim successful on node user
Oct 26 16:59:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.653s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG nova.network.neutron [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:59:16 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:59:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-470939a4-6a0f-4d53-b962-e488cee101b4 req-3e4acfa8-52c7-4be2-82a7-ca1ceaa4aef8 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Received event network-vif-plugged-a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-470939a4-6a0f-4d53-b962-e488cee101b4 req-3e4acfa8-52c7-4be2-82a7-ca1ceaa4aef8 service nova] Acquiring lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-470939a4-6a0f-4d53-b962-e488cee101b4 req-3e4acfa8-52c7-4be2-82a7-ca1ceaa4aef8 service nova] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-470939a4-6a0f-4d53-b962-e488cee101b4 req-3e4acfa8-52c7-4be2-82a7-ca1ceaa4aef8 service nova] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-470939a4-6a0f-4d53-b962-e488cee101b4 req-3e4acfa8-52c7-4be2-82a7-ca1ceaa4aef8 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] No waiting events found dispatching network-vif-plugged-a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:16 user nova-compute[75113]: WARNING nova.compute.manager [req-470939a4-6a0f-4d53-b962-e488cee101b4 req-3e4acfa8-52c7-4be2-82a7-ca1ceaa4aef8 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Received unexpected event network-vif-plugged-a1aedd8d-1f49-4949-9e8e-d1800971fd0f for instance with vm_state building and task_state spawning.
Oct 26 16:59:16 user nova-compute[75113]: DEBUG nova.policy [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25d708e692104c63ac2e25531e82d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0d356ed9284735abb524c73c143e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:59:16 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Creating image(s)
Oct 26 16:59:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "/opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "/opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "/opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "ba29afc796ea486abef8eb2be84c2bb836f7ee94" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "ba29afc796ea486abef8eb2be84c2bb836f7ee94" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94.part --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:17 user nova-compute[75113]: DEBUG nova.compute.manager [req-f270b6a1-7a1e-46c5-823c-5aa568bd9b3d req-3e844035-b646-45d1-857e-f71f62b30c27 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f270b6a1-7a1e-46c5-823c-5aa568bd9b3d req-3e844035-b646-45d1-857e-f71f62b30c27 service nova] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f270b6a1-7a1e-46c5-823c-5aa568bd9b3d req-3e844035-b646-45d1-857e-f71f62b30c27 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f270b6a1-7a1e-46c5-823c-5aa568bd9b3d req-3e844035-b646-45d1-857e-f71f62b30c27 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:17 user nova-compute[75113]: DEBUG nova.compute.manager [req-f270b6a1-7a1e-46c5-823c-5aa568bd9b3d req-3e844035-b646-45d1-857e-f71f62b30c27 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] No waiting events found dispatching network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:17 user nova-compute[75113]: WARNING nova.compute.manager [req-f270b6a1-7a1e-46c5-823c-5aa568bd9b3d req-3e844035-b646-45d1-857e-f71f62b30c27 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received unexpected event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 for instance with vm_state resized and task_state None.
Oct 26 16:59:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94.part --force-share --output=json" returned: 0 in 0.232s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:17 user nova-compute[75113]: DEBUG nova.virt.images [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] 0521c00f-82dc-45d4-8764-d12668ce2240 was qcow2, converting to raw {{(pid=75113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 16:59:17 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 16:59:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94.part /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94.converted {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:17 user nova-compute[75113]: DEBUG nova.network.neutron [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Successfully created port: ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:59:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94.part /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94.converted" returned: 0 in 0.244s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94.converted --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "ba29afc796ea486abef8eb2be84c2bb836f7ee94" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.175s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94 --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "ba29afc796ea486abef8eb2be84c2bb836f7ee94" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "ba29afc796ea486abef8eb2be84c2bb836f7ee94" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG nova.network.neutron [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Successfully updated port: ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94 --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94,backing_fmt=raw /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquired lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG nova.network.neutron [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94,backing_fmt=raw /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk 1073741824" returned: 0 in 0.049s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "ba29afc796ea486abef8eb2be84c2bb836f7ee94" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG nova.network.neutron [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94 --force-share --output=json" returned: 0 in 0.196s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Cannot resize image /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Ensure instance console log exists: /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Received event network-vif-plugged-a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] Acquiring lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] No waiting events found dispatching network-vif-plugged-a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:18 user nova-compute[75113]: WARNING nova.compute.manager [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Received unexpected event network-vif-plugged-a1aedd8d-1f49-4949-9e8e-d1800971fd0f for instance with vm_state building and task_state spawning.
Oct 26 16:59:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-changed-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Refreshing instance network info cache due to event network-changed-ff980165-116a-431e-90a0-3a1d98b79b9d. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] Acquiring lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:59:18 user nova-compute[75113]: DEBUG nova.network.neutron [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updating instance_info_cache with network_info: [{"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Releasing lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Instance network_info: |[{"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] Acquired lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.network.neutron [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Refreshing network info cache for port ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Start _get_guest_xml network_info=[{"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:59:12Z,direct_url=<?>,disk_format='qcow2',id=0521c00f-82dc-45d4-8764-d12668ce2240,min_disk=0,min_ram=0,name='tempest-scenario-img--32936148',owner='dd0d356ed9284735abb524c73c143e3b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:59:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '0521c00f-82dc-45d4-8764-d12668ce2240'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:59:19 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Instance spawned successfully.
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:59:19 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:59:19 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:59:12Z,direct_url=<?>,disk_format='qcow2',id=0521c00f-82dc-45d4-8764-d12668ce2240,min_disk=0,min_ram=0,name='tempest-scenario-img--32936148',owner='dd0d356ed9284735abb524c73c143e3b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:59:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1982662822',display_name='tempest-TestMinimumBasicScenario-server-1982662822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1982662822',id=15,image_ref='0521c00f-82dc-45d4-8764-d12668ce2240',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9WGXEXrBv1HHrw/BahosIMiFehiyfTzuTP5JS60S6ifc+z3JAckDUJ8DH1IMfHJttIi9rYDvL4URf4GCDY6zxa1JU9fTzpckEU87gTgbFD+aLdpBaRRzDKuYiuSf0lnQ==',key_name='tempest-TestMinimumBasicScenario-1651364451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd0d356ed9284735abb524c73c143e3b',ramdisk_id='',reservation_id='r-4nvn6z1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0521c00f-82dc-45d4-8764-d12668ce2240',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1757884343',owner_user_name='tempest-TestMinimumBasicScenario-1757884343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:59:17Z,user_data=None,user_id='25d708e692104c63ac2e25531e82d734',uuid=57a1b1df-ced1-4df2-8714-9aaa5f3c7e36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converting VIF {"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'pci_devices' on Instance uuid 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:59:19 user nova-compute[75113]:   <uuid>57a1b1df-ced1-4df2-8714-9aaa5f3c7e36</uuid>
Oct 26 16:59:19 user nova-compute[75113]:   <name>instance-0000000f</name>
Oct 26 16:59:19 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 16:59:19 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 16:59:19 user nova-compute[75113]:   <metadata>
Oct 26 16:59:19 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:59:19 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 16:59:19 user nova-compute[75113]:       <nova:name>tempest-TestMinimumBasicScenario-server-1982662822</nova:name>
Oct 26 16:59:19 user nova-compute[75113]:       <nova:creationTime>2023-10-26 16:59:19</nova:creationTime>
Oct 26 16:59:19 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 16:59:19 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 16:59:19 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 16:59:19 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 16:59:19 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:59:19 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:59:19 user nova-compute[75113]:       </nova:flavor>
Oct 26 16:59:19 user nova-compute[75113]:       <nova:owner>
Oct 26 16:59:19 user nova-compute[75113]:         <nova:user uuid="25d708e692104c63ac2e25531e82d734">tempest-TestMinimumBasicScenario-1757884343-project-member</nova:user>
Oct 26 16:59:19 user nova-compute[75113]:         <nova:project uuid="dd0d356ed9284735abb524c73c143e3b">tempest-TestMinimumBasicScenario-1757884343</nova:project>
Oct 26 16:59:19 user nova-compute[75113]:       </nova:owner>
Oct 26 16:59:19 user nova-compute[75113]:       <nova:root type="image" uuid="0521c00f-82dc-45d4-8764-d12668ce2240"/>
Oct 26 16:59:19 user nova-compute[75113]:       <nova:ports>
Oct 26 16:59:19 user nova-compute[75113]:         <nova:port uuid="ff980165-116a-431e-90a0-3a1d98b79b9d">
Oct 26 16:59:19 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 16:59:19 user nova-compute[75113]:         </nova:port>
Oct 26 16:59:19 user nova-compute[75113]:       </nova:ports>
Oct 26 16:59:19 user nova-compute[75113]:     </nova:instance>
Oct 26 16:59:19 user nova-compute[75113]:   </metadata>
Oct 26 16:59:19 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 16:59:19 user nova-compute[75113]:     <system>
Oct 26 16:59:19 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:59:19 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:59:19 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 16:59:19 user nova-compute[75113]:       <entry name="serial">57a1b1df-ced1-4df2-8714-9aaa5f3c7e36</entry>
Oct 26 16:59:19 user nova-compute[75113]:       <entry name="uuid">57a1b1df-ced1-4df2-8714-9aaa5f3c7e36</entry>
Oct 26 16:59:19 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:59:19 user nova-compute[75113]:     </system>
Oct 26 16:59:19 user nova-compute[75113]:   </sysinfo>
Oct 26 16:59:19 user nova-compute[75113]:   <os>
Oct 26 16:59:19 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:59:19 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 16:59:19 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 16:59:19 user nova-compute[75113]:   </os>
Oct 26 16:59:19 user nova-compute[75113]:   <features>
Oct 26 16:59:19 user nova-compute[75113]:     <acpi/>
Oct 26 16:59:19 user nova-compute[75113]:     <apic/>
Oct 26 16:59:19 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 16:59:19 user nova-compute[75113]:   </features>
Oct 26 16:59:19 user nova-compute[75113]:   <clock offset="utc">
Oct 26 16:59:19 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:59:19 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:59:19 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 16:59:19 user nova-compute[75113]:   </clock>
Oct 26 16:59:19 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 16:59:19 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 16:59:19 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:59:19 user nova-compute[75113]:   </cpu>
Oct 26 16:59:19 user nova-compute[75113]:   <devices>
Oct 26 16:59:19 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 16:59:19 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:59:19 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk"/>
Oct 26 16:59:19 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 16:59:19 user nova-compute[75113]:     </disk>
Oct 26 16:59:19 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 16:59:19 user nova-compute[75113]:       <mac address="fa:16:3e:e8:74:98"/>
Oct 26 16:59:19 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:59:19 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 16:59:19 user nova-compute[75113]:       <target dev="tapff980165-11"/>
Oct 26 16:59:19 user nova-compute[75113]:     </interface>
Oct 26 16:59:19 user nova-compute[75113]:     <serial type="pty">
Oct 26 16:59:19 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/console.log" append="off"/>
Oct 26 16:59:19 user nova-compute[75113]:     </serial>
Oct 26 16:59:19 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:59:19 user nova-compute[75113]:     <video>
Oct 26 16:59:19 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 16:59:19 user nova-compute[75113]:     </video>
Oct 26 16:59:19 user nova-compute[75113]:     <rng model="virtio">
Oct 26 16:59:19 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:59:19 user nova-compute[75113]:     </rng>
Oct 26 16:59:19 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:59:19 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 16:59:19 user nova-compute[75113]:       <stats period="10"/>
Oct 26 16:59:19 user nova-compute[75113]:     </memballoon>
Oct 26 16:59:19 user nova-compute[75113]:   </devices>
Oct 26 16:59:19 user nova-compute[75113]: </domain>
Oct 26 16:59:19 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1982662822',display_name='tempest-TestMinimumBasicScenario-server-1982662822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1982662822',id=15,image_ref='0521c00f-82dc-45d4-8764-d12668ce2240',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9WGXEXrBv1HHrw/BahosIMiFehiyfTzuTP5JS60S6ifc+z3JAckDUJ8DH1IMfHJttIi9rYDvL4URf4GCDY6zxa1JU9fTzpckEU87gTgbFD+aLdpBaRRzDKuYiuSf0lnQ==',key_name='tempest-TestMinimumBasicScenario-1651364451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd0d356ed9284735abb524c73c143e3b',ramdisk_id='',reservation_id='r-4nvn6z1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0521c00f-82dc-45d4-8764-d12668ce2240',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1757884343',owner_user_name='tempest-TestMinimumBasicScenario-1757884343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:59:17Z,user_data=None,user_id='25d708e692104c63ac2e25531e82d734',uuid=57a1b1df-ced1-4df2-8714-9aaa5f3c7e36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converting VIF {"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG os_vif [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5157665-ea61-5248-aa37-1d2f58d0c4b1', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff980165-11, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff980165-11, col_values=(('qos', UUID('3b7087df-a8e3-489c-8c9f-a489552b10f0')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff980165-11, col_values=(('external_ids', {'iface-id': 'ff980165-116a-431e-90a0-3a1d98b79b9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:74:98', 'vm-uuid': '57a1b1df-ced1-4df2-8714-9aaa5f3c7e36'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:19 user nova-compute[75113]: INFO os_vif [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11')
Oct 26 16:59:19 user nova-compute[75113]: INFO nova.compute.manager [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Took 6.35 seconds to spawn the instance on the hypervisor.
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] No VIF found with MAC fa:16:3e:e8:74:98, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:59:19 user nova-compute[75113]: INFO nova.compute.manager [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Took 7.23 seconds to build instance.
Oct 26 16:59:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fe3a6c92-b83a-4087-88f6-fe9afd7a4473 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.332s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.network.neutron [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updated VIF entry in instance network info cache for port ff980165-116a-431e-90a0-3a1d98b79b9d. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG nova.network.neutron [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updating instance_info_cache with network_info: [{"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:59:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-efd8732b-d09f-454b-b88e-8e0714d5e63a req-4b55a6dc-da71-4233-897f-2b46079213b6 service nova] Releasing lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "cafa9881-242a-4275-8125-80f415d56ee8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "cafa9881-242a-4275-8125-80f415d56ee8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG nova.objects.instance [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lazy-loading 'flavor' on Instance uuid cafa9881-242a-4275-8125-80f415d56ee8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "cafa9881-242a-4275-8125-80f415d56ee8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "cafa9881-242a-4275-8125-80f415d56ee8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "cafa9881-242a-4275-8125-80f415d56ee8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:20 user nova-compute[75113]: INFO nova.compute.manager [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Attaching volume fed35f33-631c-470a-8a9c-2ce2b96fd2b2 to /dev/vdb
Oct 26 16:59:20 user nova-compute[75113]: DEBUG os_brick.utils [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5322a709-af7d-4a83-b0bb-8ee0540d1d47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b419c1-b5f0-4fdc-8113-360477ab7449]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eb492e-8f4a-41da-bdb9-850c44d5e9a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4649a170-aaa6-4085-ab9a-7177d5c71d0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:59:20 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:59:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e64d24-eda6-45d8-9169-9068b7bb0eee]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG os_brick.utils [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Updating existing volume attachment record: 1cc96a9a-bb1b-4c31-9c09-857bd830af6b {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:59:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-2b03cbbb-6124-413e-8a53-1b5b2129b5ff req-d3c8b83a-44ca-43a1-9a09-308ed586c2b7 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b03cbbb-6124-413e-8a53-1b5b2129b5ff req-d3c8b83a-44ca-43a1-9a09-308ed586c2b7 service nova] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b03cbbb-6124-413e-8a53-1b5b2129b5ff req-d3c8b83a-44ca-43a1-9a09-308ed586c2b7 service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b03cbbb-6124-413e-8a53-1b5b2129b5ff req-d3c8b83a-44ca-43a1-9a09-308ed586c2b7 service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-2b03cbbb-6124-413e-8a53-1b5b2129b5ff req-d3c8b83a-44ca-43a1-9a09-308ed586c2b7 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] No waiting events found dispatching network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:21 user nova-compute[75113]: WARNING nova.compute.manager [req-2b03cbbb-6124-413e-8a53-1b5b2129b5ff req-d3c8b83a-44ca-43a1-9a09-308ed586c2b7 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received unexpected event network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d for instance with vm_state building and task_state spawning.
Oct 26 16:59:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-a119cd9f-fddb-49ef-bbd6-ed54fec3f75e req-d8011b25-56f5-4d86-8574-98d8cd5f0427 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-changed-5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-a119cd9f-fddb-49ef-bbd6-ed54fec3f75e req-d8011b25-56f5-4d86-8574-98d8cd5f0427 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing instance network info cache due to event network-changed-5dbfd85e-684a-4c18-b660-7491fea99a4a. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:59:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a119cd9f-fddb-49ef-bbd6-ed54fec3f75e req-d8011b25-56f5-4d86-8574-98d8cd5f0427 service nova] Acquiring lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:59:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a119cd9f-fddb-49ef-bbd6-ed54fec3f75e req-d8011b25-56f5-4d86-8574-98d8cd5f0427 service nova] Acquired lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:59:21 user nova-compute[75113]: DEBUG nova.network.neutron [req-a119cd9f-fddb-49ef-bbd6-ed54fec3f75e req-d8011b25-56f5-4d86-8574-98d8cd5f0427 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Refreshing network info cache for port 5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:59:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:22 user nova-compute[75113]: DEBUG nova.network.neutron [req-a119cd9f-fddb-49ef-bbd6-ed54fec3f75e req-d8011b25-56f5-4d86-8574-98d8cd5f0427 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updated VIF entry in instance network info cache for port 5dbfd85e-684a-4c18-b660-7491fea99a4a. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:59:22 user nova-compute[75113]: DEBUG nova.network.neutron [req-a119cd9f-fddb-49ef-bbd6-ed54fec3f75e req-d8011b25-56f5-4d86-8574-98d8cd5f0427 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating instance_info_cache with network_info: [{"id": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "address": "fa:16:3e:5e:8d:bb", "network": {"id": "c2e7c5c6-ced3-44f1-baed-3115ab05a814", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-903346093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbfd85e-68", "ovs_interfaceid": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "address": "fa:16:3e:b0:1c:4e", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ec1e1-94", "ovs_interfaceid": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "address": "fa:16:3e:66:64:d7", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46d4142-9e", "ovs_interfaceid": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "address": "fa:16:3e:c8:73:3b", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2c1443-f5", "ovs_interfaceid": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "address": "fa:16:3e:09:04:3c", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d92159e-2e", "ovs_interfaceid": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "address": "fa:16:3e:0d:40:0f", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d4dd71-2d", "ovs_interfaceid": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "address": "fa:16:3e:dc:3e:7d", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4355f4f-05", "ovs_interfaceid": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:59:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a119cd9f-fddb-49ef-bbd6-ed54fec3f75e req-d8011b25-56f5-4d86-8574-98d8cd5f0427 service nova] Releasing lock "refresh_cache-8d18f293-ebac-4392-9405-869a7e23f3e0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:59:23 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:59:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:59:23 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Instance spawned successfully.
Oct 26 16:59:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:59:23 user nova-compute[75113]: DEBUG nova.compute.manager [req-b6be42b2-e7cb-4305-b3ee-37463cae0a3f req-b7fef015-7f49-4358-b837-cd4c6de219af service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b6be42b2-e7cb-4305-b3ee-37463cae0a3f req-b7fef015-7f49-4358-b837-cd4c6de219af service nova] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b6be42b2-e7cb-4305-b3ee-37463cae0a3f req-b7fef015-7f49-4358-b837-cd4c6de219af service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b6be42b2-e7cb-4305-b3ee-37463cae0a3f req-b7fef015-7f49-4358-b837-cd4c6de219af service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:23 user nova-compute[75113]: DEBUG nova.compute.manager [req-b6be42b2-e7cb-4305-b3ee-37463cae0a3f req-b7fef015-7f49-4358-b837-cd4c6de219af service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] No waiting events found dispatching network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:23 user nova-compute[75113]: WARNING nova.compute.manager [req-b6be42b2-e7cb-4305-b3ee-37463cae0a3f req-b7fef015-7f49-4358-b837-cd4c6de219af service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received unexpected event network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d for instance with vm_state building and task_state spawning.
Oct 26 16:59:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:59:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:59:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:59:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:59:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:59:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:59:23 user nova-compute[75113]: INFO nova.compute.manager [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Took 6.26 seconds to spawn the instance on the hypervisor.
Oct 26 16:59:23 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:59:23 user nova-compute[75113]: INFO nova.compute.manager [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Took 7.37 seconds to build instance.
Oct 26 16:59:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a6a8aa14-312f-44e8-833c-8c0242222d2f tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.524s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:24 user nova-compute[75113]: INFO nova.compute.manager [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Terminating instance
Oct 26 16:59:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-30cd2bd3-1f86-4a31-9c4d-c2a1f493fd0d req-b621ba0b-249a-4661-bd64-0f408d0baca2 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-30cd2bd3-1f86-4a31-9c4d-c2a1f493fd0d req-b621ba0b-249a-4661-bd64-0f408d0baca2 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-30cd2bd3-1f86-4a31-9c4d-c2a1f493fd0d req-b621ba0b-249a-4661-bd64-0f408d0baca2 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-30cd2bd3-1f86-4a31-9c4d-c2a1f493fd0d req-b621ba0b-249a-4661-bd64-0f408d0baca2 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-30cd2bd3-1f86-4a31-9c4d-c2a1f493fd0d req-b621ba0b-249a-4661-bd64-0f408d0baca2 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-unplugged-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-30cd2bd3-1f86-4a31-9c4d-c2a1f493fd0d req-b621ba0b-249a-4661-bd64-0f408d0baca2 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:59:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-55c4393f-0058-4db1-b864-770eb7e1e252 req-10c8bef8-4287-4eaf-8034-994bf9d760ee service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55c4393f-0058-4db1-b864-770eb7e1e252 req-10c8bef8-4287-4eaf-8034-994bf9d760ee service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55c4393f-0058-4db1-b864-770eb7e1e252 req-10c8bef8-4287-4eaf-8034-994bf9d760ee service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55c4393f-0058-4db1-b864-770eb7e1e252 req-10c8bef8-4287-4eaf-8034-994bf9d760ee service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-55c4393f-0058-4db1-b864-770eb7e1e252 req-10c8bef8-4287-4eaf-8034-994bf9d760ee service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-unplugged-5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-55c4393f-0058-4db1-b864-770eb7e1e252 req-10c8bef8-4287-4eaf-8034-994bf9d760ee service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-5dbfd85e-684a-4c18-b660-7491fea99a4a for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-517876b0-e3eb-4fc6-b84f-44faf9eaa7a4 req-d7341fc6-c925-4535-9e33-998ff7af4976 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-d8d4dd71-2d05-4d5a-9818-dec95781dd73 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-517876b0-e3eb-4fc6-b84f-44faf9eaa7a4 req-d7341fc6-c925-4535-9e33-998ff7af4976 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-517876b0-e3eb-4fc6-b84f-44faf9eaa7a4 req-d7341fc6-c925-4535-9e33-998ff7af4976 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-517876b0-e3eb-4fc6-b84f-44faf9eaa7a4 req-d7341fc6-c925-4535-9e33-998ff7af4976 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-517876b0-e3eb-4fc6-b84f-44faf9eaa7a4 req-d7341fc6-c925-4535-9e33-998ff7af4976 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-unplugged-d8d4dd71-2d05-4d5a-9818-dec95781dd73 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-517876b0-e3eb-4fc6-b84f-44faf9eaa7a4 req-d7341fc6-c925-4535-9e33-998ff7af4976 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-d8d4dd71-2d05-4d5a-9818-dec95781dd73 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:26 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Instance destroyed successfully.
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.objects.instance [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lazy-loading 'resources' on Instance uuid 8d18f293-ebac-4392-9405-869a7e23f3e0 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "address": "fa:16:3e:5e:8d:bb", "network": {"id": "c2e7c5c6-ced3-44f1-baed-3115ab05a814", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-903346093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbfd85e-68", "ovs_interfaceid": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "address": "fa:16:3e:5e:8d:bb", "network": {"id": "c2e7c5c6-ced3-44f1-baed-3115ab05a814", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-903346093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbfd85e-68", "ovs_interfaceid": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:8d:bb,bridge_name='br-int',has_traffic_filtering=True,id=5dbfd85e-684a-4c18-b660-7491fea99a4a,network=Network(c2e7c5c6-ced3-44f1-baed-3115ab05a814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbfd85e-68') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:8d:bb,bridge_name='br-int',has_traffic_filtering=True,id=5dbfd85e-684a-4c18-b660-7491fea99a4a,network=Network(c2e7c5c6-ced3-44f1-baed-3115ab05a814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbfd85e-68') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dbfd85e-68, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5846bf59-6099-46d4-b087-29d8aefac0e1) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:26 user nova-compute[75113]: INFO os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:8d:bb,bridge_name='br-int',has_traffic_filtering=True,id=5dbfd85e-684a-4c18-b660-7491fea99a4a,network=Network(c2e7c5c6-ced3-44f1-baed-3115ab05a814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbfd85e-68')
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "address": "fa:16:3e:b0:1c:4e", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ec1e1-94", "ovs_interfaceid": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "address": "fa:16:3e:b0:1c:4e", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ec1e1-94", "ovs_interfaceid": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:1c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f6ec1e1-94') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:1c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f6ec1e1-94') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f6ec1e1-94, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:26 user nova-compute[75113]: WARNING nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a for instance with vm_state active and task_state deleting.
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-c46d4142-9e17-4a68-904c-f0ae8102ecc8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-unplugged-c46d4142-9e17-4a68-904c-f0ae8102ecc8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-c46d4142-9e17-4a68-904c-f0ae8102ecc8 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-c46d4142-9e17-4a68-904c-f0ae8102ecc8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-c46d4142-9e17-4a68-904c-f0ae8102ecc8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:26 user nova-compute[75113]: WARNING nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-c46d4142-9e17-4a68-904c-f0ae8102ecc8 for instance with vm_state active and task_state deleting.
Oct 26 16:59:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-unplugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:27 user nova-compute[75113]: WARNING nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 for instance with vm_state active and task_state deleting.
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:27 user nova-compute[75113]: WARNING nova.compute.manager [req-d7a75a63-15b0-479d-a44d-1b1623975845 req-8f52bf9b-a927-4444-bc00-a586dc8cdf7a service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 for instance with vm_state active and task_state deleting.
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e03cc6e-1ea9-4124-951c-da46cb23c447) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: INFO os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:1c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f6ec1e1-94')
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "address": "fa:16:3e:66:64:d7", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46d4142-9e", "ovs_interfaceid": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "address": "fa:16:3e:66:64:d7", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46d4142-9e", "ovs_interfaceid": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:64:d7,bridge_name='br-int',has_traffic_filtering=True,id=c46d4142-9e17-4a68-904c-f0ae8102ecc8,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc46d4142-9e') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:64:d7,bridge_name='br-int',has_traffic_filtering=True,id=c46d4142-9e17-4a68-904c-f0ae8102ecc8,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc46d4142-9e') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc46d4142-9e, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69510220-8bba-4f81-aacf-0b541fe7f7fc) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:27 user nova-compute[75113]: WARNING nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-5dbfd85e-684a-4c18-b660-7491fea99a4a for instance with vm_state active and task_state deleting.
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-9d92159e-2ef5-43c8-bb24-9d0f73a875ac {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-unplugged-9d92159e-2ef5-43c8-bb24-9d0f73a875ac {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-9d92159e-2ef5-43c8-bb24-9d0f73a875ac for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-9d92159e-2ef5-43c8-bb24-9d0f73a875ac {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-9d92159e-2ef5-43c8-bb24-9d0f73a875ac {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:27 user nova-compute[75113]: WARNING nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-9d92159e-2ef5-43c8-bb24-9d0f73a875ac for instance with vm_state active and task_state deleting.
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-unplugged-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:27 user nova-compute[75113]: WARNING nova.compute.manager [req-47ca2040-e158-4c93-a0d6-7df6536473b5 req-c7bcd73e-5de0-44e2-a573-5ed1f2b21be1 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 for instance with vm_state active and task_state deleting.
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: INFO os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:64:d7,bridge_name='br-int',has_traffic_filtering=True,id=c46d4142-9e17-4a68-904c-f0ae8102ecc8,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc46d4142-9e')
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "address": "fa:16:3e:c8:73:3b", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2c1443-f5", "ovs_interfaceid": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "address": "fa:16:3e:c8:73:3b", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2c1443-f5", "ovs_interfaceid": "2c2c1443-f57d-489a-a795-8ad1046af4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:73:3b,bridge_name='br-int',has_traffic_filtering=True,id=2c2c1443-f57d-489a-a795-8ad1046af4c7,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2c1443-f5') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:73:3b,bridge_name='br-int',has_traffic_filtering=True,id=2c2c1443-f57d-489a-a795-8ad1046af4c7,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2c1443-f5') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c2c1443-f5, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=189b8920-fe4e-4478-9b05-bb1db607297d) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: INFO os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:73:3b,bridge_name='br-int',has_traffic_filtering=True,id=2c2c1443-f57d-489a-a795-8ad1046af4c7,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2c1443-f5')
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "address": "fa:16:3e:09:04:3c", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d92159e-2e", "ovs_interfaceid": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "address": "fa:16:3e:09:04:3c", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d92159e-2e", "ovs_interfaceid": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=9d92159e-2ef5-43c8-bb24-9d0f73a875ac,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d92159e-2e') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=9d92159e-2ef5-43c8-bb24-9d0f73a875ac,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d92159e-2e') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d92159e-2e, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-a254910a-88bd-4016-969b-11f48b7ef990 req-14a57062-d361-4d13-aa64-bcf86cb69a59 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-d8d4dd71-2d05-4d5a-9818-dec95781dd73 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a254910a-88bd-4016-969b-11f48b7ef990 req-14a57062-d361-4d13-aa64-bcf86cb69a59 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a254910a-88bd-4016-969b-11f48b7ef990 req-14a57062-d361-4d13-aa64-bcf86cb69a59 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a254910a-88bd-4016-969b-11f48b7ef990 req-14a57062-d361-4d13-aa64-bcf86cb69a59 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-a254910a-88bd-4016-969b-11f48b7ef990 req-14a57062-d361-4d13-aa64-bcf86cb69a59 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-d8d4dd71-2d05-4d5a-9818-dec95781dd73 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:27 user nova-compute[75113]: WARNING nova.compute.manager [req-a254910a-88bd-4016-969b-11f48b7ef990 req-14a57062-d361-4d13-aa64-bcf86cb69a59 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-d8d4dd71-2d05-4d5a-9818-dec95781dd73 for instance with vm_state active and task_state deleting.
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8b3c1c6-da40-4d78-87bb-c04af5c99835) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: INFO os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=9d92159e-2ef5-43c8-bb24-9d0f73a875ac,network=Network(e51b6b7f-019f-449a-98aa-0107ed735473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d92159e-2e')
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "address": "fa:16:3e:0d:40:0f", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d4dd71-2d", "ovs_interfaceid": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "address": "fa:16:3e:0d:40:0f", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d4dd71-2d", "ovs_interfaceid": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:40:0f,bridge_name='br-int',has_traffic_filtering=True,id=d8d4dd71-2d05-4d5a-9818-dec95781dd73,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d4dd71-2d') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:40:0f,bridge_name='br-int',has_traffic_filtering=True,id=d8d4dd71-2d05-4d5a-9818-dec95781dd73,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d4dd71-2d') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8d4dd71-2d, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35fec0a1-b750-4625-a80d-b44b1cd4f1bf) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: INFO os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:40:0f,bridge_name='br-int',has_traffic_filtering=True,id=d8d4dd71-2d05-4d5a-9818-dec95781dd73,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d4dd71-2d')
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T16:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630236209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630236209',id=10,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVKfGmXWUfDq3RUIgGmgdjLjDZplVB/b3fCDknW6mI7RAA61Th8eFqHXKZiDSLRCYPwJz4+T1bQuTnr3kmM4RJxYO/APHp56/17C4xwnaK+fTnzDrbc4CrVR7yBms9GA==',key_name='tempest-keypair-1770675838',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='173647d78bcc49e3ba74a76991fdb619',ramdisk_id='',reservation_id='r-4nvnunni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762168988',owner_user_name='tempest-TaggedBootDevicesTest_v242-762168988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7507eb0467eb48bb94804ed84e57a42c',uuid=8d18f293-ebac-4392-9405-869a7e23f3e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "address": "fa:16:3e:dc:3e:7d", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4355f4f-05", "ovs_interfaceid": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converting VIF {"id": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "address": "fa:16:3e:dc:3e:7d", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4355f4f-05", "ovs_interfaceid": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d4355f4f-05b7-4b2e-afe4-af2377a4f4b6,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4355f4f-05') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d4355f4f-05b7-4b2e-afe4-af2377a4f4b6,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4355f4f-05') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4355f4f-05, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e4c0b7e-2040-4b88-99ec-cee5b0499f5b) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:27 user nova-compute[75113]: INFO os_vif [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d4355f4f-05b7-4b2e-afe4-af2377a4f4b6,network=Network(8a227d6b-b2a9-4f86-885b-03feda038206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4355f4f-05')
Oct 26 16:59:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OurNYSXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:59:27 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eb6850-70c4-419e-af91-4fa88f53aec5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:59:27 user nova-compute[75113]: No targets found.
Oct 26 16:59:27 user nova-compute[75113]: iSNS:
Oct 26 16:59:27 user nova-compute[75113]: No targets found.
Oct 26 16:59:27 user nova-compute[75113]: STATIC:
Oct 26 16:59:27 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac
Oct 26 16:59:27 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:27 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:27 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f
Oct 26 16:59:27 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:27 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:27 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7
Oct 26 16:59:27 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:27 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:27 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08
Oct 26 16:59:27 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:27 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:27 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad
Oct 26 16:59:27 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:27 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:27 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00
Oct 26 16:59:27 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:27 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:27 user nova-compute[75113]: FIRMWARE:
Oct 26 16:59:27 user nova-compute[75113]: No targets found.
Oct 26 16:59:27 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:59:27 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:59:27 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d99583-6313-41fb-ae32-3bb2d0b9ea25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacf2c30-fc9a-46cc-861b-c3d87462b085]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:59:27 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:27 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:59:27 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:27 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:59:27 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:59:27 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:59:27 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:27 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:59:27 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:27 user nova-compute[75113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac (non-flash)
Oct 26 16:59:27 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:59:27 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49143d9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac'): ({'sdg'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Removing single pathed devices sdg {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d90762-92dd-4864-814e-e496a20b8364]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cabc7c3-74ab-4062-8a46-e3e3d008c25f]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Flushing IO for device /dev/sdg {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9a9bb3-b5fa-4056-b90b-c6c0614327a8]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.065s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[85018e94-0990-49ea-8b12-50c308365bf8]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] SCSI volumes sdg have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e965d953-92bf-432c-90f3-7c768959c3ce]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8922a3a3-d914-46f4-b327-2f8a124ab80e]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac, portal: 172.16.0.220,3260]
Oct 26 16:59:28 user nova-compute[75113]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac, portal: 172.16.0.220,3260] successful.
Oct 26 16:59:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f451bb25-be49-4269-b788-16b1a0b42aac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d81440-bcae-4773-ace5-e78beb27c329]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] <== disconnect_volume: return (404ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FexGqsnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:59:28 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c242a4-ba83-415d-8598-a703ca1c0524]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:59:28 user nova-compute[75113]: No targets found.
Oct 26 16:59:28 user nova-compute[75113]: iSNS:
Oct 26 16:59:28 user nova-compute[75113]: No targets found.
Oct 26 16:59:28 user nova-compute[75113]: STATIC:
Oct 26 16:59:28 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f
Oct 26 16:59:28 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:28 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:28 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7
Oct 26 16:59:28 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:28 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:28 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08
Oct 26 16:59:28 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:28 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:28 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad
Oct 26 16:59:28 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:28 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:28 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00
Oct 26 16:59:28 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:28 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:28 user nova-compute[75113]: FIRMWARE:
Oct 26 16:59:28 user nova-compute[75113]: No targets found.
Oct 26 16:59:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:59:28 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:59:28 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab5e009-7dcb-4836-8933-e82c50db4e50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d73718a-1322-4889-b255-a3000def28ed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:59:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f (non-flash)
Oct 26 16:59:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49143d9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[619a23f2-4cb4-4958-98c2-a8a875681b8e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f79e4d-d554-421a-b361-5028aa159313]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1bdd15-5b82-420a-8a6f-77aefee40f53]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[79782dc7-f23a-432a-a7a6-da5c67fc4afa]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac1dc4a-02f2-4bda-ba54-1926d242afac]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e57134-6498-49e6-b6ff-36c9cf570153]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f, portal: 172.16.0.220,3260]
Oct 26 16:59:28 user nova-compute[75113]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f, portal: 172.16.0.220,3260] successful.
Oct 26 16:59:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9241a060-213c-4215-8885-59d29315ca6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a9f613-2a6e-40e7-9445-d55cc57a81ec]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] <== disconnect_volume: return (397ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpKMgVkG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:59:28 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[99064968-b3e5-4169-908b-7623c14da993]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:59:28 user nova-compute[75113]: No targets found.
Oct 26 16:59:28 user nova-compute[75113]: iSNS:
Oct 26 16:59:28 user nova-compute[75113]: No targets found.
Oct 26 16:59:28 user nova-compute[75113]: STATIC:
Oct 26 16:59:28 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7
Oct 26 16:59:28 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:28 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:28 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08
Oct 26 16:59:28 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:28 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:28 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad
Oct 26 16:59:28 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:28 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:28 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00
Oct 26 16:59:28 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:59:28 user nova-compute[75113]:                 Iface Name: default
Oct 26 16:59:28 user nova-compute[75113]: FIRMWARE:
Oct 26 16:59:28 user nova-compute[75113]: No targets found.
Oct 26 16:59:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:59:28 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:59:28 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a57e26-5ee4-4683-b3b0-808fbe062db7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c8b2cc-1eb0-4059-ac5b-cb252ff01e90]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:59:28 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49143d9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7'): ({'sdd'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Removing single pathed devices sdd {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a518a86c-14fc-470e-b82c-834e44d442ca]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7c2535-5065-4d3b-927a-ab6524bcd553]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Flushing IO for device /dev/sdd {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4291e3e3-9725-4bc1-b504-85d08856c6e2]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[99320486-6395-4533-adc1-00b10f92d810]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] SCSI volumes sdd have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[229adb71-24ea-48d8-943c-f017fdc228a5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[50497c1d-a0e6-4284-b99e-a1784f05e0aa]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7, portal: 172.16.0.220,3260]
Oct 26 16:59:28 user nova-compute[75113]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7, portal: 172.16.0.220,3260] successful.
Oct 26 16:59:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744f5bef-bbc8-48f4-9376-4ed4731670d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f48397-1041-4329-ba77-ae38f6e183ba]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] <== disconnect_volume: return (393ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:59:28 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Deleting instance files /opt/stack/data/nova/instances/8d18f293-ebac-4392-9405-869a7e23f3e0_del
Oct 26 16:59:28 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Deletion of /opt/stack/data/nova/instances/8d18f293-ebac-4392-9405-869a7e23f3e0_del complete
Oct 26 16:59:28 user nova-compute[75113]: INFO nova.compute.manager [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Took 4.74 seconds to destroy the instance on the hypervisor.
Oct 26 16:59:28 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:59:28 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:29 user nova-compute[75113]: WARNING nova.compute.manager [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 for instance with vm_state active and task_state deleting.
Oct 26 16:59:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-unplugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-unplugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] Acquiring lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] No waiting events found dispatching network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:59:29 user nova-compute[75113]: WARNING nova.compute.manager [req-3b58f7ec-d7fe-4016-a471-e21972c8b1a9 req-5f2f124f-8418-4b40-8a45-dfebefea4994 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received unexpected event network-vif-plugged-2c2c1443-f57d-489a-a795-8ad1046af4c7 for instance with vm_state active and task_state deleting.
Oct 26 16:59:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:31 user nova-compute[75113]: DEBUG nova.compute.manager [req-b54bd711-c8df-4cee-a243-94d0329916b9 req-e06924a9-c663-4052-97f9-6e9db264d6c5 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-deleted-2c2c1443-f57d-489a-a795-8ad1046af4c7 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:31 user nova-compute[75113]: INFO nova.compute.manager [req-b54bd711-c8df-4cee-a243-94d0329916b9 req-e06924a9-c663-4052-97f9-6e9db264d6c5 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Neutron deleted interface 2c2c1443-f57d-489a-a795-8ad1046af4c7; detaching it from the instance and deleting it from the info cache
Oct 26 16:59:31 user nova-compute[75113]: DEBUG nova.network.neutron [req-b54bd711-c8df-4cee-a243-94d0329916b9 req-e06924a9-c663-4052-97f9-6e9db264d6c5 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating instance_info_cache with network_info: [{"id": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "address": "fa:16:3e:5e:8d:bb", "network": {"id": "c2e7c5c6-ced3-44f1-baed-3115ab05a814", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-903346093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbfd85e-68", "ovs_interfaceid": "5dbfd85e-684a-4c18-b660-7491fea99a4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "address": "fa:16:3e:b0:1c:4e", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ec1e1-94", "ovs_interfaceid": "5f6ec1e1-9464-4198-9cbd-1d85a5b6ce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "address": "fa:16:3e:66:64:d7", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46d4142-9e", "ovs_interfaceid": "c46d4142-9e17-4a68-904c-f0ae8102ecc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "address": "fa:16:3e:09:04:3c", "network": {"id": "e51b6b7f-019f-449a-98aa-0107ed735473", "bridge": "br-int", "label": "tempest-device-tagging-net1-2027162685", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d92159e-2e", "ovs_interfaceid": "9d92159e-2ef5-43c8-bb24-9d0f73a875ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "address": "fa:16:3e:0d:40:0f", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d4dd71-2d", "ovs_interfaceid": "d8d4dd71-2d05-4d5a-9818-dec95781dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "address": "fa:16:3e:dc:3e:7d", "network": {"id": "8a227d6b-b2a9-4f86-885b-03feda038206", "bridge": "br-int", "label": "tempest-device-tagging-net2-173717910", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "173647d78bcc49e3ba74a76991fdb619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4355f4f-05", "ovs_interfaceid": "d4355f4f-05b7-4b2e-afe4-af2377a4f4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:59:31 user nova-compute[75113]: DEBUG nova.compute.manager [req-b54bd711-c8df-4cee-a243-94d0329916b9 req-e06924a9-c663-4052-97f9-6e9db264d6c5 service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Detach interface failed, port_id=2c2c1443-f57d-489a-a795-8ad1046af4c7, reason: Instance 8d18f293-ebac-4392-9405-869a7e23f3e0 could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 16:59:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:33 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:59:33 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Took 4.25 seconds to deallocate network for instance.
Oct 26 16:59:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-ac6ed39a-7d38-47c1-bc3a-2fa755b39b82 req-654baee5-b218-451c-b7cf-47eea25e9a9d service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-deleted-5dbfd85e-684a-4c18-b660-7491fea99a4a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-ac6ed39a-7d38-47c1-bc3a-2fa755b39b82 req-654baee5-b218-451c-b7cf-47eea25e9a9d service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-deleted-9d92159e-2ef5-43c8-bb24-9d0f73a875ac {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-ac6ed39a-7d38-47c1-bc3a-2fa755b39b82 req-654baee5-b218-451c-b7cf-47eea25e9a9d service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-deleted-d8d4dd71-2d05-4d5a-9818-dec95781dd73 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-ac6ed39a-7d38-47c1-bc3a-2fa755b39b82 req-654baee5-b218-451c-b7cf-47eea25e9a9d service nova] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Received event network-vif-deleted-d4355f4f-05b7-4b2e-afe4-af2377a4f4b6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:59:35 user nova-compute[75113]: INFO nova.compute.manager [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] [instance: 8d18f293-ebac-4392-9405-869a7e23f3e0] Took 2.67 seconds to detach 3 volumes for instance.
Oct 26 16:59:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:36 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:59:36 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:59:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.600s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:36 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Deleted allocations for instance 8d18f293-ebac-4392-9405-869a7e23f3e0
Oct 26 16:59:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5acfa60e-1209-4913-aa60-e05f00b0b31a tempest-TaggedBootDevicesTest_v242-762168988 tempest-TaggedBootDevicesTest_v242-762168988-project-member] Lock "8d18f293-ebac-4392-9405-869a7e23f3e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.476s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmiMlITJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:59:43 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:59:43 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:59:43 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a346905-18f9-4a5b-b9ef-fc758bee32e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:59:43 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff2fb79-9c9a-4e39-a9e9-40aa749eb834]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2] added
Oct 26 16:59:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cc389e-3788-4423-a99c-21355ede3621]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6711d0-9b7c-47a1-abe3-9687ca62bd05]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmiMlITJ {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmiMlITJ" returned: 0 in 0.117s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81b318b-4ca9-4e7c-b2f4-436804736bde]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NmiMlITJ'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ac85a6-6138-477f-af63-1d01fde5d094]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8e56bb-c903-4848-904a-793856dfd4a7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:43 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:59:43 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:43 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:59:43 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8857bca-92e3-4b94-ba38-c7779e5042ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2, portal: 172.16.0.220,3260]
Oct 26 16:59:43 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2, portal: 172.16.0.220,3260] successful.
Oct 26 16:59:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d64adb-bcce-4634-9330-ff09ffb922b0]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1ab6fe-a572-47ab-acc9-715d1fd8688b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:43 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:59:43 user nova-compute[75113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 (non-flash)
Oct 26 16:59:43 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 16:59:43 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 16:59:43 user nova-compute[75113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 (non-flash)
Oct 26 16:59:43 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 16:59:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d29aef-b9c8-400a-8e31-180d132a3fa0]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:59:43 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:59:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:59:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmiMlITJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:59:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:59:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '23733636130656665', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:59:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733636130656665', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:59:44 user nova-compute[75113]: DEBUG nova.objects.instance [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lazy-loading 'flavor' on Instance uuid cafa9881-242a-4275-8125-80f415d56ee8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:59:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:59:45 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:59:45 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 16:59:45 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:59:45 user nova-compute[75113]:   <serial>fed35f33-631c-470a-8a9c-2ce2b96fd2b2</serial>
Oct 26 16:59:45 user nova-compute[75113]: </disk>
Oct 26 16:59:45 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:59:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:59:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:59:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] No VIF found with MAC fa:16:3e:fd:e6:f5, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:59:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-12f4a5b6-8746-4655-9718-1bc9248a55d9 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "cafa9881-242a-4275-8125-80f415d56ee8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.219s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:59:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "cafa9881-242a-4275-8125-80f415d56ee8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:59:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "cafa9881-242a-4275-8125-80f415d56ee8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:59:47 user nova-compute[75113]: INFO nova.compute.manager [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Detaching volume fed35f33-631c-470a-8a9c-2ce2b96fd2b2
Oct 26 16:59:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:47 user nova-compute[75113]: INFO nova.virt.block_device [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Attempting to driver detach volume fed35f33-631c-470a-8a9c-2ce2b96fd2b2 from mountpoint /dev/vdb
Oct 26 16:59:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Attempting to detach device vdb from instance cafa9881-242a-4275-8125-80f415d56ee8 from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:59:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:59:47 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:59:47 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 16:59:47 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:59:47 user nova-compute[75113]:   <serial>fed35f33-631c-470a-8a9c-2ce2b96fd2b2</serial>
Oct 26 16:59:47 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:59:47 user nova-compute[75113]: </disk>
Oct 26 16:59:47 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:59:47 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Successfully detached device vdb from instance cafa9881-242a-4275-8125-80f415d56ee8 from the persistent domain config.
Oct 26 16:59:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cafa9881-242a-4275-8125-80f415d56ee8 from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:59:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:59:47 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:59:47 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 16:59:47 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:59:47 user nova-compute[75113]:   <serial>fed35f33-631c-470a-8a9c-2ce2b96fd2b2</serial>
Oct 26 16:59:47 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:59:47 user nova-compute[75113]: </disk>
Oct 26 16:59:47 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:59:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cafa9881-242a-4275-8125-80f415d56ee8 {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:59:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:59:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:56 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:59:56 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:59:56 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 16:59:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:56 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] There are 0 instances to clean {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 16:59:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:58 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:59:58 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:59:58 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 16:59:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:59:59 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:00:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:00:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:00:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:00:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:00:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 17:00:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:01 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:00:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:01 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:00:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:00:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:02 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:00:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:00:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:06 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:00:06 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7191MB free_disk=25.183765411376953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Applying migration context for instance 645deae0-4c03-41d0-aa3b-daa79ed25425 as it has an incoming, in-progress migration 54b08be3-ea1f-483d-af4a-b0502177fae0. Migration status is finished {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 17:00:06 user nova-compute[75113]: INFO nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating resource usage from migration 54b08be3-ea1f-483d-af4a-b0502177fae0
Oct 26 17:00:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 69ed2396-a603-4c84-a66b-7b474523b68e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance f1769d95-897b-4e83-89ba-c486aa086dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fbf1e605-91c5-4188-9081-f9762ad92a9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance a8368686-8c4d-4373-a3a5-4498e2086e0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance cafa9881-242a-4275-8125-80f415d56ee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 413deca1-2056-455a-b7c6-e0730ea1a57e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Migration 54b08be3-ea1f-483d-af4a-b0502177fae0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 645deae0-4c03-41d0-aa3b-daa79ed25425 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing inventories for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating ProviderTree inventory for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating inventory in ProviderTree for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing aggregate associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, aggregates: None {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing trait associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:00:06 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:00:07 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:00:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.845s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:07 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:00:07 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:00:07 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:00:07 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:00:08 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cafa9881-242a-4275-8125-80f415d56ee8 is timed out.
Oct 26 17:00:08 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Successfully detached device vdb from instance cafa9881-242a-4275-8125-80f415d56ee8 from the live domain config.
Oct 26 17:00:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmiMlITJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:00:08 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[767f9493-ce01-4cb3-a65d-0efb514c2cad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:00:08 user nova-compute[75113]: No targets found.
Oct 26 17:00:08 user nova-compute[75113]: iSNS:
Oct 26 17:00:08 user nova-compute[75113]: No targets found.
Oct 26 17:00:08 user nova-compute[75113]: STATIC:
Oct 26 17:00:08 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2
Oct 26 17:00:08 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:00:08 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:00:08 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08
Oct 26 17:00:08 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:00:08 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:00:08 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad
Oct 26 17:00:08 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:00:08 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:00:08 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00
Oct 26 17:00:08 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:00:08 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:00:08 user nova-compute[75113]: FIRMWARE:
Oct 26 17:00:08 user nova-compute[75113]: No targets found.
Oct 26 17:00:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:00:08 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:00:08 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00535cc-cc84-4dbb-ad70-47a431eaceaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8849843a-81d5-4544-874b-84e3f7a70fae]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 17:00:08 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:00:08 user nova-compute[75113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 (non-flash)
Oct 26 17:00:08 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 17:00:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 17:00:08 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:00:08 user nova-compute[75113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 (non-flash)
Oct 26 17:00:08 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 17:00:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914212830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc0004b-31d8-40e6-85c6-9d5e50d28a89]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e225040-fc33-487c-95fd-17b449e8dcf2]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[21095ac9-bcea-416e-abd8-461dc2b77faf]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7711825e-9acd-4ab8-9001-efb1efc1e301]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e821bb-e9f4-4726-b0c3-f69a4a979729]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08c98eb-9a04-41d9-b123-8ee67af10212]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2, portal: 172.16.0.220,3260]
Oct 26 17:00:08 user nova-compute[75113]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2, portal: 172.16.0.220,3260] successful.
Oct 26 17:00:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed35f33-631c-470a-8a9c-2ce2b96fd2b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ec6b48-368a-4c22-b5e5-5d7ad451fdaf]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] <== disconnect_volume: return (341ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:00:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:00:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:00:10 user nova-compute[75113]: INFO nova.compute.manager [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] instance snapshotting
Oct 26 17:00:10 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Beginning live snapshot process
Oct 26 17:00:10 user nova-compute[75113]: INFO nova.compute.manager [None req-512f5da8-fd5e-4cb8-a6b0-e0b9a8eac4dc tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Unrescuing
Oct 26 17:00:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-512f5da8-fd5e-4cb8-a6b0-e0b9a8eac4dc tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:00:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-512f5da8-fd5e-4cb8-a6b0-e0b9a8eac4dc tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquired lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:00:10 user nova-compute[75113]: DEBUG nova.network.neutron [None req-512f5da8-fd5e-4cb8-a6b0-e0b9a8eac4dc tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:00:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json -f qcow2 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json -f qcow2 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvqvmc8fk/91aae404f76e4fbdb8f7496b85ad8296.delta 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvqvmc8fk/91aae404f76e4fbdb8f7496b85ad8296.delta 1073741824" returned: 0 in 0.048s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:11 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 17:00:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG nova.network.neutron [None req-512f5da8-fd5e-4cb8-a6b0-e0b9a8eac4dc tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updating instance_info_cache with network_info: [{"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-512f5da8-fd5e-4cb8-a6b0-e0b9a8eac4dc tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Releasing lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG nova.objects.instance [None req-512f5da8-fd5e-4cb8-a6b0-e0b9a8eac4dc tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lazy-loading 'flavor' on Instance uuid 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG nova.compute.manager [req-129eddf7-e880-4fc9-a0dc-826c079a428a req-8d8d935c-8643-46e7-8441-4ea969600ab0 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-vif-unplugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-129eddf7-e880-4fc9-a0dc-826c079a428a req-8d8d935c-8643-46e7-8441-4ea969600ab0 service nova] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-129eddf7-e880-4fc9-a0dc-826c079a428a req-8d8d935c-8643-46e7-8441-4ea969600ab0 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-129eddf7-e880-4fc9-a0dc-826c079a428a req-8d8d935c-8643-46e7-8441-4ea969600ab0 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:11 user nova-compute[75113]: DEBUG nova.compute.manager [req-129eddf7-e880-4fc9-a0dc-826c079a428a req-8d8d935c-8643-46e7-8441-4ea969600ab0 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] No waiting events found dispatching network-vif-unplugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:00:11 user nova-compute[75113]: WARNING nova.compute.manager [req-129eddf7-e880-4fc9-a0dc-826c079a428a req-8d8d935c-8643-46e7-8441-4ea969600ab0 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received unexpected event network-vif-unplugged-0502d8bd-666e-4f27-8c38-e060b44ce264 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:00:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=75113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 17:00:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:12 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Instance destroyed successfully.
Oct 26 17:00:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 17:00:12 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 17:00:12 user nova-compute[75113]: DEBUG nova.compute.manager [req-262f3cc0-6768-4ece-9bf3-d109763b0453 req-87d9254e-1915-4c3d-8988-cf8a303ca084 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-changed-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:12 user nova-compute[75113]: DEBUG nova.compute.manager [req-262f3cc0-6768-4ece-9bf3-d109763b0453 req-87d9254e-1915-4c3d-8988-cf8a303ca084 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Refreshing instance network info cache due to event network-changed-0502d8bd-666e-4f27-8c38-e060b44ce264. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:00:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-262f3cc0-6768-4ece-9bf3-d109763b0453 req-87d9254e-1915-4c3d-8988-cf8a303ca084 service nova] Acquiring lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:00:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-262f3cc0-6768-4ece-9bf3-d109763b0453 req-87d9254e-1915-4c3d-8988-cf8a303ca084 service nova] Acquired lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:00:12 user nova-compute[75113]: DEBUG nova.network.neutron [req-262f3cc0-6768-4ece-9bf3-d109763b0453 req-87d9254e-1915-4c3d-8988-cf8a303ca084 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Refreshing network info cache for port 0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:00:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:12 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 17:00:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvqvmc8fk/91aae404f76e4fbdb8f7496b85ad8296.delta /opt/stack/data/nova/instances/snapshots/tmpvqvmc8fk/91aae404f76e4fbdb8f7496b85ad8296 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvqvmc8fk/91aae404f76e4fbdb8f7496b85ad8296.delta /opt/stack/data/nova/instances/snapshots/tmpvqvmc8fk/91aae404f76e4fbdb8f7496b85ad8296" returned: 0 in 0.286s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:13 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Snapshot extracted, beginning image upload
Oct 26 17:00:13 user nova-compute[75113]: DEBUG nova.network.neutron [req-262f3cc0-6768-4ece-9bf3-d109763b0453 req-87d9254e-1915-4c3d-8988-cf8a303ca084 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updated VIF entry in instance network info cache for port 0502d8bd-666e-4f27-8c38-e060b44ce264. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:00:13 user nova-compute[75113]: DEBUG nova.network.neutron [req-262f3cc0-6768-4ece-9bf3-d109763b0453 req-87d9254e-1915-4c3d-8988-cf8a303ca084 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updating instance_info_cache with network_info: [{"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:00:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-262f3cc0-6768-4ece-9bf3-d109763b0453 req-87d9254e-1915-4c3d-8988-cf8a303ca084 service nova] Releasing lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:00:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:13 user nova-compute[75113]: DEBUG nova.compute.manager [req-904118ce-df64-455d-a552-1370f23a8914 req-badede29-f35f-40c0-bfa2-c290203694f4 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-904118ce-df64-455d-a552-1370f23a8914 req-badede29-f35f-40c0-bfa2-c290203694f4 service nova] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-904118ce-df64-455d-a552-1370f23a8914 req-badede29-f35f-40c0-bfa2-c290203694f4 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-904118ce-df64-455d-a552-1370f23a8914 req-badede29-f35f-40c0-bfa2-c290203694f4 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:13 user nova-compute[75113]: DEBUG nova.compute.manager [req-904118ce-df64-455d-a552-1370f23a8914 req-badede29-f35f-40c0-bfa2-c290203694f4 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] No waiting events found dispatching network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:00:13 user nova-compute[75113]: WARNING nova.compute.manager [req-904118ce-df64-455d-a552-1370f23a8914 req-badede29-f35f-40c0-bfa2-c290203694f4 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received unexpected event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:00:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-89933320-a200-479e-972b-e0986026f50e req-fdd9ba60-c4a0-4089-a4c1-e4a8813b290d service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-changed-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-89933320-a200-479e-972b-e0986026f50e req-fdd9ba60-c4a0-4089-a4c1-e4a8813b290d service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Refreshing instance network info cache due to event network-changed-0502d8bd-666e-4f27-8c38-e060b44ce264. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:00:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-89933320-a200-479e-972b-e0986026f50e req-fdd9ba60-c4a0-4089-a4c1-e4a8813b290d service nova] Acquiring lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:00:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-89933320-a200-479e-972b-e0986026f50e req-fdd9ba60-c4a0-4089-a4c1-e4a8813b290d service nova] Acquired lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:00:14 user nova-compute[75113]: DEBUG nova.network.neutron [req-89933320-a200-479e-972b-e0986026f50e req-fdd9ba60-c4a0-4089-a4c1-e4a8813b290d service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Refreshing network info cache for port 0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:00:15 user nova-compute[75113]: DEBUG nova.network.neutron [req-89933320-a200-479e-972b-e0986026f50e req-fdd9ba60-c4a0-4089-a4c1-e4a8813b290d service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updated VIF entry in instance network info cache for port 0502d8bd-666e-4f27-8c38-e060b44ce264. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:00:15 user nova-compute[75113]: DEBUG nova.network.neutron [req-89933320-a200-479e-972b-e0986026f50e req-fdd9ba60-c4a0-4089-a4c1-e4a8813b290d service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updating instance_info_cache with network_info: [{"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:00:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-89933320-a200-479e-972b-e0986026f50e req-fdd9ba60-c4a0-4089-a4c1-e4a8813b290d service nova] Releasing lock "refresh_cache-69ed2396-a603-4c84-a66b-7b474523b68e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:00:15 user nova-compute[75113]: DEBUG nova.compute.manager [req-f92aff4b-4760-49e2-91d3-412d84875685 req-45db32c2-e0e2-404d-8d39-34b7307106d2 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f92aff4b-4760-49e2-91d3-412d84875685 req-45db32c2-e0e2-404d-8d39-34b7307106d2 service nova] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f92aff4b-4760-49e2-91d3-412d84875685 req-45db32c2-e0e2-404d-8d39-34b7307106d2 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f92aff4b-4760-49e2-91d3-412d84875685 req-45db32c2-e0e2-404d-8d39-34b7307106d2 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:15 user nova-compute[75113]: DEBUG nova.compute.manager [req-f92aff4b-4760-49e2-91d3-412d84875685 req-45db32c2-e0e2-404d-8d39-34b7307106d2 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] No waiting events found dispatching network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:00:15 user nova-compute[75113]: WARNING nova.compute.manager [req-f92aff4b-4760-49e2-91d3-412d84875685 req-45db32c2-e0e2-404d-8d39-34b7307106d2 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received unexpected event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:00:15 user nova-compute[75113]: DEBUG nova.compute.manager [req-f92aff4b-4760-49e2-91d3-412d84875685 req-45db32c2-e0e2-404d-8d39-34b7307106d2 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f92aff4b-4760-49e2-91d3-412d84875685 req-45db32c2-e0e2-404d-8d39-34b7307106d2 service nova] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f92aff4b-4760-49e2-91d3-412d84875685 req-45db32c2-e0e2-404d-8d39-34b7307106d2 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f92aff4b-4760-49e2-91d3-412d84875685 req-45db32c2-e0e2-404d-8d39-34b7307106d2 service nova] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:15 user nova-compute[75113]: DEBUG nova.compute.manager [req-f92aff4b-4760-49e2-91d3-412d84875685 req-45db32c2-e0e2-404d-8d39-34b7307106d2 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] No waiting events found dispatching network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:00:15 user nova-compute[75113]: WARNING nova.compute.manager [req-f92aff4b-4760-49e2-91d3-412d84875685 req-45db32c2-e0e2-404d-8d39-34b7307106d2 service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received unexpected event network-vif-plugged-0502d8bd-666e-4f27-8c38-e060b44ce264 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:00:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-512f5da8-fd5e-4cb8-a6b0-e0b9a8eac4dc tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:00:16 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Snapshot image upload complete
Oct 26 17:00:16 user nova-compute[75113]: INFO nova.compute.manager [None req-25b73803-1169-44fe-9a34-da2aeaf0565d tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Took 6.35 seconds to snapshot the instance on the hypervisor.
Oct 26 17:00:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:17 user nova-compute[75113]: DEBUG nova.objects.instance [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lazy-loading 'flavor' on Instance uuid cafa9881-242a-4275-8125-80f415d56ee8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:00:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f34ce94-f62a-4143-aa72-24a96e88a11f tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "cafa9881-242a-4275-8125-80f415d56ee8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.226s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:27 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Port 96d708f7-00f7-44af-9bc6-43882921ea03 binding to destination host user is already ACTIVE {{(pid=75113) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 17:00:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:00:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquired lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:00:27 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:00:28 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating instance_info_cache with network_info: [{"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:00:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Releasing lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:00:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Creating tmpfile /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/tmpwx4rqlaj to verify with other compute node that the instance is on the same shared storage. {{(pid=75113) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 26 17:00:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-0cb2c9ff-7b4b-44d9-88eb-86e50b5c9476 req-f1356ba1-4709-40fc-bdec-fc654dec5ff1 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-unplugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0cb2c9ff-7b4b-44d9-88eb-86e50b5c9476 req-f1356ba1-4709-40fc-bdec-fc654dec5ff1 service nova] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0cb2c9ff-7b4b-44d9-88eb-86e50b5c9476 req-f1356ba1-4709-40fc-bdec-fc654dec5ff1 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0cb2c9ff-7b4b-44d9-88eb-86e50b5c9476 req-f1356ba1-4709-40fc-bdec-fc654dec5ff1 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-0cb2c9ff-7b4b-44d9-88eb-86e50b5c9476 req-f1356ba1-4709-40fc-bdec-fc654dec5ff1 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] No waiting events found dispatching network-vif-unplugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:00:28 user nova-compute[75113]: WARNING nova.compute.manager [req-0cb2c9ff-7b4b-44d9-88eb-86e50b5c9476 req-f1356ba1-4709-40fc-bdec-fc654dec5ff1 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received unexpected event network-vif-unplugged-96d708f7-00f7-44af-9bc6-43882921ea03 for instance with vm_state resized and task_state resize_reverting.
Oct 26 17:00:29 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Instance destroyed successfully.
Oct 26 17:00:29 user nova-compute[75113]: DEBUG nova.objects.instance [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lazy-loading 'resources' on Instance uuid 645deae0-4c03-41d0-aa3b-daa79ed25425 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1163194343',display_name='tempest-ServerActionsTestOtherB-server-1163194343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1163194343',id=2,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNi6S0kdc5pWvhxq2azP5QRonb6qXMUiteND1nfP3Uf2jZWYfGzWg8fbqOsk4PAj062T9NqyLIEevO2i2GpMs0q5myp5A+SX7ogwodc86c3yyzOTm1sjFsenkun5EW0fg==',key_name='tempest-keypair-1305775717',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:59:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='992a6be3e5814c3b80c705763af5de1e',ramdisk_id='',reservation_id='r-fvz5sf1r',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1008157220',owner_user_name='tempest-ServerActionsTestOtherB-1008157220-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f45ddba3b44d1b9333b282e43b02e8',uuid=645deae0-4c03-41d0-aa3b-daa79ed25425,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converting VIF {"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_vif [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96d708f7-00, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfdc2bbc-e875-44aa-be57-b4716c30f692) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:29 user nova-compute[75113]: INFO os_vif [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00')
Oct 26 17:00:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAOpQCYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:00:29 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d33fe5-cdf9-4bcc-bd9c-86b410e71464]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:00:29 user nova-compute[75113]: No targets found.
Oct 26 17:00:29 user nova-compute[75113]: iSNS:
Oct 26 17:00:29 user nova-compute[75113]: No targets found.
Oct 26 17:00:29 user nova-compute[75113]: STATIC:
Oct 26 17:00:29 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08
Oct 26 17:00:29 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:00:29 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:00:29 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad
Oct 26 17:00:29 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:00:29 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:00:29 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00
Oct 26 17:00:29 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:00:29 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:00:29 user nova-compute[75113]: FIRMWARE:
Oct 26 17:00:29 user nova-compute[75113]: No targets found.
Oct 26 17:00:29 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:00:29 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:00:29 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca31acc-6df1-4e9d-ad1d-708e34d07090]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd520709-3faa-4dc6-a082-c0a7b8dc310e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 17:00:29 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:00:29 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 17:00:29 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 17:00:29 user nova-compute[75113]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:00:29 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 17:00:29 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f491428bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad'): ({'sdf'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Removing single pathed devices sdf {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[27564a1d-5a50-43a6-88d6-91c561f8f75b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8c68bf-4091-4e30-b747-e2a44f98baac]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Flushing IO for device /dev/sdf {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[54871ed3-ad14-42fa-924e-7f5bc13f5924]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.032s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3de2fe7-40c7-43d2-a443-8f45bea06aa5]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] SCSI volumes sdf have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadee81b-d33e-4866-97d1-650e5ffa2bd7]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d08d6b-1cb4-489d-9d37-711ecf7bd004]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260]
Oct 26 17:00:29 user nova-compute[75113]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260] successful.
Oct 26 17:00:29 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d70f82-4e33-486f-907e-a113102dd9bb]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] <== disconnect_volume: return (290ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:00:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:00:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:30 user nova-compute[75113]: DEBUG nova.objects.instance [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lazy-loading 'migration_context' on Instance uuid 645deae0-4c03-41d0-aa3b-daa79ed25425 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:00:30 user nova-compute[75113]: DEBUG nova.objects.base [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Object Instance<645deae0-4c03-41d0-aa3b-daa79ed25425> lazy-loaded attributes: resources,migration_context {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:00:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-4e047721-3f43-4b6e-ab22-829b66164652 req-1a3e6d71-f6b0-4ad0-9a54-d1824e55f177 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4e047721-3f43-4b6e-ab22-829b66164652 req-1a3e6d71-f6b0-4ad0-9a54-d1824e55f177 service nova] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4e047721-3f43-4b6e-ab22-829b66164652 req-1a3e6d71-f6b0-4ad0-9a54-d1824e55f177 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4e047721-3f43-4b6e-ab22-829b66164652 req-1a3e6d71-f6b0-4ad0-9a54-d1824e55f177 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-4e047721-3f43-4b6e-ab22-829b66164652 req-1a3e6d71-f6b0-4ad0-9a54-d1824e55f177 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] No waiting events found dispatching network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:00:30 user nova-compute[75113]: WARNING nova.compute.manager [req-4e047721-3f43-4b6e-ab22-829b66164652 req-1a3e6d71-f6b0-4ad0-9a54-d1824e55f177 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received unexpected event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 for instance with vm_state resized and task_state resize_reverting.
Oct 26 17:00:30 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:00:30 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:00:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.488s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:31 user nova-compute[75113]: INFO nova.compute.manager [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Swapping old allocation on dict_keys(['c33cb59b-e90a-48cc-9491-b92264d66bd5']) held by migration 54b08be3-ea1f-483d-af4a-b0502177fae0 for instance
Oct 26 17:00:31 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Overwriting current allocation {'allocations': {'c33cb59b-e90a-48cc-9491-b92264d66bd5': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 19}}, 'project_id': '992a6be3e5814c3b80c705763af5de1e', 'user_id': '38f45ddba3b44d1b9333b282e43b02e8', 'consumer_generation': 1} on consumer 645deae0-4c03-41d0-aa3b-daa79ed25425 {{(pid=75113) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquired lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating instance_info_cache with network_info: [{"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Releasing lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG os_brick.utils [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac20bf5-815a-4af5-ba28-b01303b633f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd76f9c-bd17-45e8-862d-2a15b3e66105]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9d78f0-cb73-4e5e-8102-cd8c7f5a7985]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c78b95-1754-4e19-a12c-d697f38823dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:00:31 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:00:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a7f354-e93c-4829-9b51-63c6a731887e]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:00:31 user nova-compute[75113]: DEBUG os_brick.utils [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:00:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:38 user nova-compute[75113]: INFO nova.compute.manager [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Detaching volume 92367020-5467-406a-bff3-0089938acf08
Oct 26 17:00:38 user nova-compute[75113]: INFO nova.virt.block_device [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Attempting to driver detach volume 92367020-5467-406a-bff3-0089938acf08 from mountpoint /dev/vdb
Oct 26 17:00:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Attempting to detach device vdb from instance fbf1e605-91c5-4188-9081-f9762ad92a9f from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:00:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:00:38 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:00:38 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:00:38 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:00:38 user nova-compute[75113]:   <serial>92367020-5467-406a-bff3-0089938acf08</serial>
Oct 26 17:00:38 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:00:38 user nova-compute[75113]: </disk>
Oct 26 17:00:38 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:00:38 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Successfully detached device vdb from instance fbf1e605-91c5-4188-9081-f9762ad92a9f from the persistent domain config.
Oct 26 17:00:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fbf1e605-91c5-4188-9081-f9762ad92a9f from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:00:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:00:38 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:00:38 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:00:38 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:00:38 user nova-compute[75113]:   <serial>92367020-5467-406a-bff3-0089938acf08</serial>
Oct 26 17:00:38 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:00:38 user nova-compute[75113]: </disk>
Oct 26 17:00:38 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:00:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fbf1e605-91c5-4188-9081-f9762ad92a9f {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:00:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "413deca1-2056-455a-b7c6-e0730ea1a57e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:42 user nova-compute[75113]: INFO nova.compute.manager [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Terminating instance
Oct 26 17:00:42 user nova-compute[75113]: DEBUG nova.compute.manager [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:00:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG nova.compute.manager [req-476b1587-ce6b-4a89-918f-336493b73ed9 req-2124c808-7f25-4457-84ed-656253696248 service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Received event network-vif-unplugged-43ab0866-ca31-415e-bf5c-a5a7cc93f39a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-476b1587-ce6b-4a89-918f-336493b73ed9 req-2124c808-7f25-4457-84ed-656253696248 service nova] Acquiring lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-476b1587-ce6b-4a89-918f-336493b73ed9 req-2124c808-7f25-4457-84ed-656253696248 service nova] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-476b1587-ce6b-4a89-918f-336493b73ed9 req-2124c808-7f25-4457-84ed-656253696248 service nova] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG nova.compute.manager [req-476b1587-ce6b-4a89-918f-336493b73ed9 req-2124c808-7f25-4457-84ed-656253696248 service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] No waiting events found dispatching network-vif-unplugged-43ab0866-ca31-415e-bf5c-a5a7cc93f39a {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG nova.compute.manager [req-476b1587-ce6b-4a89-918f-336493b73ed9 req-2124c808-7f25-4457-84ed-656253696248 service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Received event network-vif-unplugged-43ab0866-ca31-415e-bf5c-a5a7cc93f39a for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:00:43 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Instance destroyed successfully.
Oct 26 17:00:43 user nova-compute[75113]: DEBUG nova.objects.instance [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lazy-loading 'resources' on Instance uuid 413deca1-2056-455a-b7c6-e0730ea1a57e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-173446413',display_name='tempest-VolumesAdminNegativeTest-server-173446413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-173446413',id=12,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:58:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66ee9d2be45d4517a2cfea00177b1c15',ramdisk_id='',reservation_id='r-yfgpykbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1147285819',owner_user_name='tempest-VolumesAdminNegativeTest-1147285819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:58:30Z,user_data=None,user_id='f9ca04a69e784bc38c31b5ca256d3a94',uuid=413deca1-2056-455a-b7c6-e0730ea1a57e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "address": "fa:16:3e:22:a3:1d", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab0866-ca", "ovs_interfaceid": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Converting VIF {"id": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "address": "fa:16:3e:22:a3:1d", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab0866-ca", "ovs_interfaceid": "43ab0866-ca31-415e-bf5c-a5a7cc93f39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:a3:1d,bridge_name='br-int',has_traffic_filtering=True,id=43ab0866-ca31-415e-bf5c-a5a7cc93f39a,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab0866-ca') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG os_vif [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:a3:1d,bridge_name='br-int',has_traffic_filtering=True,id=43ab0866-ca31-415e-bf5c-a5a7cc93f39a,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab0866-ca') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43ab0866-ca, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=813f0e07-aa53-45af-830f-a3956b77cac3) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:43 user nova-compute[75113]: INFO os_vif [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:a3:1d,bridge_name='br-int',has_traffic_filtering=True,id=43ab0866-ca31-415e-bf5c-a5a7cc93f39a,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab0866-ca')
Oct 26 17:00:43 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Deleting instance files /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e_del
Oct 26 17:00:43 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Deletion of /opt/stack/data/nova/instances/413deca1-2056-455a-b7c6-e0730ea1a57e_del complete
Oct 26 17:00:43 user nova-compute[75113]: INFO nova.compute.manager [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 26 17:00:43 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:00:43 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:00:44 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:00:44 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Took 0.88 seconds to deallocate network for instance.
Oct 26 17:00:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-1bbb961d-2424-4ffb-b388-647bd9262a6c req-bd4c3134-c3b7-4faf-b2e3-c6b0727034c0 service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Received event network-vif-deleted-43ab0866-ca31-415e-bf5c-a5a7cc93f39a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "69ed2396-a603-4c84-a66b-7b474523b68e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:44 user nova-compute[75113]: INFO nova.compute.manager [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Detaching volume 80806a8c-ae83-411e-b575-f4ccb122db00
Oct 26 17:00:44 user nova-compute[75113]: INFO nova.virt.block_device [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Attempting to driver detach volume 80806a8c-ae83-411e-b575-f4ccb122db00 from mountpoint /dev/vdb
Oct 26 17:00:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Attempting to detach device vdb from instance 69ed2396-a603-4c84-a66b-7b474523b68e from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:00:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:00:44 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:00:44 user nova-compute[75113]:   <source dev="/dev/sde"/>
Oct 26 17:00:44 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:00:44 user nova-compute[75113]:   <serial>80806a8c-ae83-411e-b575-f4ccb122db00</serial>
Oct 26 17:00:44 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:00:44 user nova-compute[75113]: </disk>
Oct 26 17:00:44 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:00:45 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Successfully detached device vdb from instance 69ed2396-a603-4c84-a66b-7b474523b68e from the persistent domain config.
Oct 26 17:00:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69ed2396-a603-4c84-a66b-7b474523b68e from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:00:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:00:45 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:00:45 user nova-compute[75113]:   <source dev="/dev/sde"/>
Oct 26 17:00:45 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:00:45 user nova-compute[75113]:   <serial>80806a8c-ae83-411e-b575-f4ccb122db00</serial>
Oct 26 17:00:45 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:00:45 user nova-compute[75113]: </disk>
Oct 26 17:00:45 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:00:45 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:00:45 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:00:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:45 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Deleted allocations for instance 413deca1-2056-455a-b7c6-e0730ea1a57e
Oct 26 17:00:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-e6267f9c-0207-40e7-8a2d-eaf8a1dcf58b req-4cf6c5cd-b0fe-409c-a47c-8e74501c9f3b service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Received event network-vif-plugged-43ab0866-ca31-415e-bf5c-a5a7cc93f39a {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e6267f9c-0207-40e7-8a2d-eaf8a1dcf58b req-4cf6c5cd-b0fe-409c-a47c-8e74501c9f3b service nova] Acquiring lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e6267f9c-0207-40e7-8a2d-eaf8a1dcf58b req-4cf6c5cd-b0fe-409c-a47c-8e74501c9f3b service nova] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e6267f9c-0207-40e7-8a2d-eaf8a1dcf58b req-4cf6c5cd-b0fe-409c-a47c-8e74501c9f3b service nova] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-e6267f9c-0207-40e7-8a2d-eaf8a1dcf58b req-4cf6c5cd-b0fe-409c-a47c-8e74501c9f3b service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] No waiting events found dispatching network-vif-plugged-43ab0866-ca31-415e-bf5c-a5a7cc93f39a {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:00:45 user nova-compute[75113]: WARNING nova.compute.manager [req-e6267f9c-0207-40e7-8a2d-eaf8a1dcf58b req-4cf6c5cd-b0fe-409c-a47c-8e74501c9f3b service nova] [instance: 413deca1-2056-455a-b7c6-e0730ea1a57e] Received unexpected event network-vif-plugged-43ab0866-ca31-415e-bf5c-a5a7cc93f39a for instance with vm_state deleted and task_state None.
Oct 26 17:00:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-54661f55-17a1-47c9-b617-c79397119966 tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "413deca1-2056-455a-b7c6-e0730ea1a57e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.578s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:00:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:00:48 user nova-compute[75113]: INFO nova.compute.claims [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Claim successful on node user
Oct 26 17:00:48 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:00:48 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:00:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:00:48 user nova-compute[75113]: INFO nova.virt.block_device [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Booting with volume 28c72787-3acd-414f-9c4d-af5a4be57620 at /dev/vda
Oct 26 17:00:48 user nova-compute[75113]: DEBUG os_brick.utils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0769ba0d-e3a4-4032-a009-d335b14c9e34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a189720f-f0ec-440a-b3de-144dc15707b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG nova.policy [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4715aee69ed453eb02e312435fb6621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7ccf18d4d8467f961b5ec1e8df785b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4744229e-e4ba-4741-a441-27e711daac30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37bbc62-9065-44f6-a4a7-f5cb0b5be25f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:00:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:00:49 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:00:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb92e91-fd48-49f6-adb1-dd943c4203f6]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:00:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:00:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:00:49 user nova-compute[75113]: DEBUG os_brick.utils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:00:49 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating existing volume attachment record: dead6c75-239e-4add-8e52-495b6e1ee22a {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:00:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Successfully created port: 95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:00:50 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Successfully created port: fe1957f9-f87b-4d7b-98f9-425e92dbd68d {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:00:50 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Successfully created port: 1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "a8368686-8c4d-4373-a3a5-4498e2086e0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:52 user nova-compute[75113]: INFO nova.compute.manager [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Terminating instance
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Successfully created port: 037fd8ce-526b-4c04-bd17-4402781e28ed {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Acquiring lock "dd051355-efa5-40a9-a1fc-89ddb87c456e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-f985963b-4b24-4b9a-8af9-9cac9ac88c15 req-d47360ae-4906-4c3c-bdb2-8ed1e49ce93c service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Received event network-vif-unplugged-52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f985963b-4b24-4b9a-8af9-9cac9ac88c15 req-d47360ae-4906-4c3c-bdb2-8ed1e49ce93c service nova] Acquiring lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f985963b-4b24-4b9a-8af9-9cac9ac88c15 req-d47360ae-4906-4c3c-bdb2-8ed1e49ce93c service nova] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f985963b-4b24-4b9a-8af9-9cac9ac88c15 req-d47360ae-4906-4c3c-bdb2-8ed1e49ce93c service nova] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-f985963b-4b24-4b9a-8af9-9cac9ac88c15 req-d47360ae-4906-4c3c-bdb2-8ed1e49ce93c service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] No waiting events found dispatching network-vif-unplugged-52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-f985963b-4b24-4b9a-8af9-9cac9ac88c15 req-d47360ae-4906-4c3c-bdb2-8ed1e49ce93c service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Received event network-vif-unplugged-52953b56-70f6-4307-9368-7622665234cb for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:00:52 user nova-compute[75113]: INFO nova.compute.claims [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Claim successful on node user
Oct 26 17:00:52 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Instance destroyed successfully.
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.objects.instance [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lazy-loading 'resources' on Instance uuid a8368686-8c4d-4373-a3a5-4498e2086e0d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:55:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1886833755',display_name='tempest-VolumesSnapshotTestJSON-instance-1886833755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1886833755',id=9,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsgiw9wwZEneAl2mGFhjiCMItq1om3KMF6mUaG0y8H8ZdzGadtV3YxhKn8BVayd0I2FOR1jLrftT6sJD7K3U2MkmzyxF4ofuu9zfpA2yNaFE6yRLAaivNc8tdRotKPstg==',key_name='tempest-keypair-163189256',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:55:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49e6333344bf4cc6904e13f9fbe6005f',ramdisk_id='',reservation_id='r-wthxvkl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1537589693',owner_user_name='tempest-VolumesSnapshotTestJSON-1537589693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22531c3975dc4e29ab0e7be404592d01',uuid=a8368686-8c4d-4373-a3a5-4498e2086e0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52953b56-70f6-4307-9368-7622665234cb", "address": "fa:16:3e:ef:35:6f", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52953b56-70", "ovs_interfaceid": "52953b56-70f6-4307-9368-7622665234cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Converting VIF {"id": "52953b56-70f6-4307-9368-7622665234cb", "address": "fa:16:3e:ef:35:6f", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52953b56-70", "ovs_interfaceid": "52953b56-70f6-4307-9368-7622665234cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:35:6f,bridge_name='br-int',has_traffic_filtering=True,id=52953b56-70f6-4307-9368-7622665234cb,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52953b56-70') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG os_vif [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:35:6f,bridge_name='br-int',has_traffic_filtering=True,id=52953b56-70f6-4307-9368-7622665234cb,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52953b56-70') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52953b56-70, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9680e6d8-7ff7-4d2d-ba5f-3d05b285d772) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:52 user nova-compute[75113]: INFO os_vif [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:35:6f,bridge_name='br-int',has_traffic_filtering=True,id=52953b56-70f6-4307-9368-7622665234cb,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52953b56-70')
Oct 26 17:00:52 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Deleting instance files /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d_del
Oct 26 17:00:52 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Deletion of /opt/stack/data/nova/instances/a8368686-8c4d-4373-a3a5-4498e2086e0d_del complete
Oct 26 17:00:52 user nova-compute[75113]: INFO nova.compute.manager [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 26 17:00:52 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:00:52 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Successfully created port: 5c34234e-daf0-44a0-8c1c-94721e415e19 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG nova.network.neutron [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:00:53 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:00:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:00:53 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Creating image(s)
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "/opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "/opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG nova.policy [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40ac662c40c44c51b75907edc5824055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2907f465cdf34e34b5578433ac098eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.213s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk 1073741824" returned: 0 in 0.071s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:53 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:00:53 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Took 1.06 seconds to deallocate network for instance.
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.256s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Cannot resize image /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Ensure instance console log exists: /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-c46f4188-17ef-422a-8c30-847be76aff8b req-6a556cf0-7c3f-4ee8-ae93-44893480906b service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Received event network-vif-plugged-52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c46f4188-17ef-422a-8c30-847be76aff8b req-6a556cf0-7c3f-4ee8-ae93-44893480906b service nova] Acquiring lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c46f4188-17ef-422a-8c30-847be76aff8b req-6a556cf0-7c3f-4ee8-ae93-44893480906b service nova] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c46f4188-17ef-422a-8c30-847be76aff8b req-6a556cf0-7c3f-4ee8-ae93-44893480906b service nova] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-c46f4188-17ef-422a-8c30-847be76aff8b req-6a556cf0-7c3f-4ee8-ae93-44893480906b service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] No waiting events found dispatching network-vif-plugged-52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:00:54 user nova-compute[75113]: WARNING nova.compute.manager [req-c46f4188-17ef-422a-8c30-847be76aff8b req-6a556cf0-7c3f-4ee8-ae93-44893480906b service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Received unexpected event network-vif-plugged-52953b56-70f6-4307-9368-7622665234cb for instance with vm_state deleted and task_state None.
Oct 26 17:00:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-c46f4188-17ef-422a-8c30-847be76aff8b req-6a556cf0-7c3f-4ee8-ae93-44893480906b service nova] [instance: a8368686-8c4d-4373-a3a5-4498e2086e0d] Received event network-vif-deleted-52953b56-70f6-4307-9368-7622665234cb {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:54 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Deleted allocations for instance a8368686-8c4d-4373-a3a5-4498e2086e0d
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1457047-ca3b-49de-993a-6d4dea92d1b4 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "a8368686-8c4d-4373-a3a5-4498e2086e0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.849s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Successfully updated port: 95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-cf5ce7e0-79a5-4762-afcd-d7de956153be req-cc7a8711-fecf-42e1-ae57-1d5dd444b32b service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-changed-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-cf5ce7e0-79a5-4762-afcd-d7de956153be req-cc7a8711-fecf-42e1-ae57-1d5dd444b32b service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing instance network info cache due to event network-changed-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cf5ce7e0-79a5-4762-afcd-d7de956153be req-cc7a8711-fecf-42e1-ae57-1d5dd444b32b service nova] Acquiring lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cf5ce7e0-79a5-4762-afcd-d7de956153be req-cc7a8711-fecf-42e1-ae57-1d5dd444b32b service nova] Acquired lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:00:54 user nova-compute[75113]: DEBUG nova.network.neutron [req-cf5ce7e0-79a5-4762-afcd-d7de956153be req-cc7a8711-fecf-42e1-ae57-1d5dd444b32b service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing network info cache for port 95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG nova.network.neutron [req-cf5ce7e0-79a5-4762-afcd-d7de956153be req-cc7a8711-fecf-42e1-ae57-1d5dd444b32b service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG nova.network.neutron [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Successfully created port: c56a7bab-9148-426a-8c9f-960a14205cb2 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG nova.network.neutron [req-cf5ce7e0-79a5-4762-afcd-d7de956153be req-cc7a8711-fecf-42e1-ae57-1d5dd444b32b service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cf5ce7e0-79a5-4762-afcd-d7de956153be req-cc7a8711-fecf-42e1-ae57-1d5dd444b32b service nova] Releasing lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:00:55 user nova-compute[75113]: WARNING nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] While synchronizing instance power states, found 10 instances in the database and 7 instances on the hypervisor.
Oct 26 17:00:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 645deae0-4c03-41d0-aa3b-daa79ed25425 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid f1769d95-897b-4e83-89ba-c486aa086dc1 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid fbf1e605-91c5-4188-9081-f9762ad92a9f {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid cafa9881-242a-4275-8125-80f415d56ee8 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 04f0351c-6347-4353-bc70-ffa74158496c {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid ff2781bd-106d-4cdb-844c-41c58a191a88 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 76039e5a-db02-48b4-81eb-a7383d1374b1 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid dd051355-efa5-40a9-a1fc-89ddb87c456e {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:55 user nova-compute[75113]: INFO nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "f1769d95-897b-4e83-89ba-c486aa086dc1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "cafa9881-242a-4275-8125-80f415d56ee8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "cafa9881-242a-4275-8125-80f415d56ee8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "04f0351c-6347-4353-bc70-ffa74158496c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "04f0351c-6347-4353-bc70-ffa74158496c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "ff2781bd-106d-4cdb-844c-41c58a191a88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "dd051355-efa5-40a9-a1fc-89ddb87c456e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "cafa9881-242a-4275-8125-80f415d56ee8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "04f0351c-6347-4353-bc70-ffa74158496c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:56 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Successfully updated port: aa8c9bd5-e40f-45d7-addc-a0f5773791c5 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:00:56 user nova-compute[75113]: DEBUG nova.network.neutron [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Successfully updated port: c56a7bab-9148-426a-8c9f-960a14205cb2 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:00:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Acquiring lock "refresh_cache-dd051355-efa5-40a9-a1fc-89ddb87c456e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:00:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Acquired lock "refresh_cache-dd051355-efa5-40a9-a1fc-89ddb87c456e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:00:56 user nova-compute[75113]: DEBUG nova.network.neutron [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:00:56 user nova-compute[75113]: DEBUG nova.network.neutron [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-changed-aa8c9bd5-e40f-45d7-addc-a0f5773791c5 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing instance network info cache due to event network-changed-aa8c9bd5-e40f-45d7-addc-a0f5773791c5. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] Acquiring lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] Acquired lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.network.neutron [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing network info cache for port aa8c9bd5-e40f-45d7-addc-a0f5773791c5 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.network.neutron [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.network.neutron [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Updating instance_info_cache with network_info: [{"id": "c56a7bab-9148-426a-8c9f-960a14205cb2", "address": "fa:16:3e:c0:f1:53", "network": {"id": "b960d722-049c-4c9d-a19b-482e751ddb0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "314c50648df9400297d4a6a4d8aab9e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56a7bab-91", "ovs_interfaceid": "c56a7bab-9148-426a-8c9f-960a14205cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Releasing lock "refresh_cache-dd051355-efa5-40a9-a1fc-89ddb87c456e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Instance network_info: |[{"id": "c56a7bab-9148-426a-8c9f-960a14205cb2", "address": "fa:16:3e:c0:f1:53", "network": {"id": "b960d722-049c-4c9d-a19b-482e751ddb0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "314c50648df9400297d4a6a4d8aab9e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56a7bab-91", "ovs_interfaceid": "c56a7bab-9148-426a-8c9f-960a14205cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Start _get_guest_xml network_info=[{"id": "c56a7bab-9148-426a-8c9f-960a14205cb2", "address": "fa:16:3e:c0:f1:53", "network": {"id": "b960d722-049c-4c9d-a19b-482e751ddb0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "314c50648df9400297d4a6a4d8aab9e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56a7bab-91", "ovs_interfaceid": "c56a7bab-9148-426a-8c9f-960a14205cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:00:57 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:00:57 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:00:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1037029726',display_name='tempest-VolumesNegativeTest-instance-1037029726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1037029726',id=17,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2907f465cdf34e34b5578433ac098eb4',ramdisk_id='',reservation_id='r-1us01xfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1058379337',owner_user_name='tempest-VolumesNegativeTest-1058379337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:53Z,user_data=None,user_id='40ac662c40c44c51b75907edc5824055',uuid=dd051355-efa5-40a9-a1fc-89ddb87c456e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c56a7bab-9148-426a-8c9f-960a14205cb2", "address": "fa:16:3e:c0:f1:53", "network": {"id": "b960d722-049c-4c9d-a19b-482e751ddb0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "314c50648df9400297d4a6a4d8aab9e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56a7bab-91", "ovs_interfaceid": "c56a7bab-9148-426a-8c9f-960a14205cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Converting VIF {"id": "c56a7bab-9148-426a-8c9f-960a14205cb2", "address": "fa:16:3e:c0:f1:53", "network": {"id": "b960d722-049c-4c9d-a19b-482e751ddb0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "314c50648df9400297d4a6a4d8aab9e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56a7bab-91", "ovs_interfaceid": "c56a7bab-9148-426a-8c9f-960a14205cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c56a7bab-9148-426a-8c9f-960a14205cb2,network=Network(b960d722-049c-4c9d-a19b-482e751ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56a7bab-91') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.objects.instance [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lazy-loading 'pci_devices' on Instance uuid dd051355-efa5-40a9-a1fc-89ddb87c456e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:00:57 user nova-compute[75113]:   <uuid>dd051355-efa5-40a9-a1fc-89ddb87c456e</uuid>
Oct 26 17:00:57 user nova-compute[75113]:   <name>instance-00000011</name>
Oct 26 17:00:57 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:00:57 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:00:57 user nova-compute[75113]:   <metadata>
Oct 26 17:00:57 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:00:57 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:00:57 user nova-compute[75113]:       <nova:name>tempest-VolumesNegativeTest-instance-1037029726</nova:name>
Oct 26 17:00:57 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:00:57</nova:creationTime>
Oct 26 17:00:57 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:00:57 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:00:57 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:00:57 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:00:57 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:00:57 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:00:57 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:00:57 user nova-compute[75113]:       <nova:owner>
Oct 26 17:00:57 user nova-compute[75113]:         <nova:user uuid="40ac662c40c44c51b75907edc5824055">tempest-VolumesNegativeTest-1058379337-project-member</nova:user>
Oct 26 17:00:57 user nova-compute[75113]:         <nova:project uuid="2907f465cdf34e34b5578433ac098eb4">tempest-VolumesNegativeTest-1058379337</nova:project>
Oct 26 17:00:57 user nova-compute[75113]:       </nova:owner>
Oct 26 17:00:57 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:00:57 user nova-compute[75113]:       <nova:ports>
Oct 26 17:00:57 user nova-compute[75113]:         <nova:port uuid="c56a7bab-9148-426a-8c9f-960a14205cb2">
Oct 26 17:00:57 user nova-compute[75113]:           <nova:ip type="fixed" address="192.168.233.203" ipVersion="4"/>
Oct 26 17:00:57 user nova-compute[75113]:         </nova:port>
Oct 26 17:00:57 user nova-compute[75113]:       </nova:ports>
Oct 26 17:00:57 user nova-compute[75113]:     </nova:instance>
Oct 26 17:00:57 user nova-compute[75113]:   </metadata>
Oct 26 17:00:57 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:00:57 user nova-compute[75113]:     <system>
Oct 26 17:00:57 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:00:57 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:00:57 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:00:57 user nova-compute[75113]:       <entry name="serial">dd051355-efa5-40a9-a1fc-89ddb87c456e</entry>
Oct 26 17:00:57 user nova-compute[75113]:       <entry name="uuid">dd051355-efa5-40a9-a1fc-89ddb87c456e</entry>
Oct 26 17:00:57 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:00:57 user nova-compute[75113]:     </system>
Oct 26 17:00:57 user nova-compute[75113]:   </sysinfo>
Oct 26 17:00:57 user nova-compute[75113]:   <os>
Oct 26 17:00:57 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:00:57 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:00:57 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:00:57 user nova-compute[75113]:   </os>
Oct 26 17:00:57 user nova-compute[75113]:   <features>
Oct 26 17:00:57 user nova-compute[75113]:     <acpi/>
Oct 26 17:00:57 user nova-compute[75113]:     <apic/>
Oct 26 17:00:57 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:00:57 user nova-compute[75113]:   </features>
Oct 26 17:00:57 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:00:57 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:00:57 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:00:57 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:00:57 user nova-compute[75113]:   </clock>
Oct 26 17:00:57 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:00:57 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:00:57 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:00:57 user nova-compute[75113]:   </cpu>
Oct 26 17:00:57 user nova-compute[75113]:   <devices>
Oct 26 17:00:57 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:00:57 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:00:57 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk"/>
Oct 26 17:00:57 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:00:57 user nova-compute[75113]:     </disk>
Oct 26 17:00:57 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:00:57 user nova-compute[75113]:       <mac address="fa:16:3e:c0:f1:53"/>
Oct 26 17:00:57 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:00:57 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:00:57 user nova-compute[75113]:       <target dev="tapc56a7bab-91"/>
Oct 26 17:00:57 user nova-compute[75113]:     </interface>
Oct 26 17:00:57 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:00:57 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/console.log" append="off"/>
Oct 26 17:00:57 user nova-compute[75113]:     </serial>
Oct 26 17:00:57 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:00:57 user nova-compute[75113]:     <video>
Oct 26 17:00:57 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:00:57 user nova-compute[75113]:     </video>
Oct 26 17:00:57 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:00:57 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:00:57 user nova-compute[75113]:     </rng>
Oct 26 17:00:57 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:00:57 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:00:57 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:00:57 user nova-compute[75113]:     </memballoon>
Oct 26 17:00:57 user nova-compute[75113]:   </devices>
Oct 26 17:00:57 user nova-compute[75113]: </domain>
Oct 26 17:00:57 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:00:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1037029726',display_name='tempest-VolumesNegativeTest-instance-1037029726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1037029726',id=17,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2907f465cdf34e34b5578433ac098eb4',ramdisk_id='',reservation_id='r-1us01xfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1058379337',owner_user_name='tempest-VolumesNegativeTest-1058379337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:53Z,user_data=None,user_id='40ac662c40c44c51b75907edc5824055',uuid=dd051355-efa5-40a9-a1fc-89ddb87c456e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c56a7bab-9148-426a-8c9f-960a14205cb2", "address": "fa:16:3e:c0:f1:53", "network": {"id": "b960d722-049c-4c9d-a19b-482e751ddb0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "314c50648df9400297d4a6a4d8aab9e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56a7bab-91", "ovs_interfaceid": "c56a7bab-9148-426a-8c9f-960a14205cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Converting VIF {"id": "c56a7bab-9148-426a-8c9f-960a14205cb2", "address": "fa:16:3e:c0:f1:53", "network": {"id": "b960d722-049c-4c9d-a19b-482e751ddb0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "314c50648df9400297d4a6a4d8aab9e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56a7bab-91", "ovs_interfaceid": "c56a7bab-9148-426a-8c9f-960a14205cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c56a7bab-9148-426a-8c9f-960a14205cb2,network=Network(b960d722-049c-4c9d-a19b-482e751ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56a7bab-91') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG os_vif [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c56a7bab-9148-426a-8c9f-960a14205cb2,network=Network(b960d722-049c-4c9d-a19b-482e751ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56a7bab-91') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03ff78bb-a9ec-57c5-a355-54a1a2212d40', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.network.neutron [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc56a7bab-91, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc56a7bab-91, col_values=(('qos', UUID('9b12f31e-150b-4a55-a5d7-e4a1227746ce')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc56a7bab-91, col_values=(('external_ids', {'iface-id': 'c56a7bab-9148-426a-8c9f-960a14205cb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:f1:53', 'vm-uuid': 'dd051355-efa5-40a9-a1fc-89ddb87c456e'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] Releasing lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Received event network-changed-c56a7bab-9148-426a-8c9f-960a14205cb2 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Refreshing instance network info cache due to event network-changed-c56a7bab-9148-426a-8c9f-960a14205cb2. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] Acquiring lock "refresh_cache-dd051355-efa5-40a9-a1fc-89ddb87c456e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] Acquired lock "refresh_cache-dd051355-efa5-40a9-a1fc-89ddb87c456e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.network.neutron [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Refreshing network info cache for port c56a7bab-9148-426a-8c9f-960a14205cb2 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:57 user nova-compute[75113]: INFO os_vif [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c56a7bab-9148-426a-8c9f-960a14205cb2,network=Network(b960d722-049c-4c9d-a19b-482e751ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56a7bab-91')
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] No VIF found with MAC fa:16:3e:c0:f1:53, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Successfully updated port: 71eaa7ff-686b-4e1b-94b5-0b572d28e68b {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.network.neutron [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Updated VIF entry in instance network info cache for port c56a7bab-9148-426a-8c9f-960a14205cb2. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:00:57 user nova-compute[75113]: DEBUG nova.network.neutron [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Updating instance_info_cache with network_info: [{"id": "c56a7bab-9148-426a-8c9f-960a14205cb2", "address": "fa:16:3e:c0:f1:53", "network": {"id": "b960d722-049c-4c9d-a19b-482e751ddb0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "314c50648df9400297d4a6a4d8aab9e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56a7bab-91", "ovs_interfaceid": "c56a7bab-9148-426a-8c9f-960a14205cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:00:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-370bcc70-67d2-4d0a-a3b7-3e34c1afa736 req-31144ef3-24b4-469a-b7fb-28e3efceeba3 service nova] Releasing lock "refresh_cache-dd051355-efa5-40a9-a1fc-89ddb87c456e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:00:58 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:00:58 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Successfully updated port: fe1957f9-f87b-4d7b-98f9-425e92dbd68d {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-changed-71eaa7ff-686b-4e1b-94b5-0b572d28e68b {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing instance network info cache due to event network-changed-71eaa7ff-686b-4e1b-94b5-0b572d28e68b. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] Acquiring lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] Acquired lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG nova.network.neutron [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing network info cache for port 71eaa7ff-686b-4e1b-94b5-0b572d28e68b {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-cfb8e02b-f91b-490f-a974-dfdf6e232b90 req-defc74aa-b9ba-4694-9df5-db608d7e7127 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Received event network-vif-plugged-c56a7bab-9148-426a-8c9f-960a14205cb2 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cfb8e02b-f91b-490f-a974-dfdf6e232b90 req-defc74aa-b9ba-4694-9df5-db608d7e7127 service nova] Acquiring lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cfb8e02b-f91b-490f-a974-dfdf6e232b90 req-defc74aa-b9ba-4694-9df5-db608d7e7127 service nova] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cfb8e02b-f91b-490f-a974-dfdf6e232b90 req-defc74aa-b9ba-4694-9df5-db608d7e7127 service nova] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-cfb8e02b-f91b-490f-a974-dfdf6e232b90 req-defc74aa-b9ba-4694-9df5-db608d7e7127 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] No waiting events found dispatching network-vif-plugged-c56a7bab-9148-426a-8c9f-960a14205cb2 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:00:59 user nova-compute[75113]: WARNING nova.compute.manager [req-cfb8e02b-f91b-490f-a974-dfdf6e232b90 req-defc74aa-b9ba-4694-9df5-db608d7e7127 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Received unexpected event network-vif-plugged-c56a7bab-9148-426a-8c9f-960a14205cb2 for instance with vm_state building and task_state spawning.
Oct 26 17:00:59 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Successfully updated port: 1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:00:59 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fbf1e605-91c5-4188-9081-f9762ad92a9f is timed out.
Oct 26 17:00:59 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Successfully detached device vdb from instance fbf1e605-91c5-4188-9081-f9762ad92a9f from the live domain config.
Oct 26 17:00:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQrLwfmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:00:59 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c74f6a2-af26-4273-904a-a6d18d2cbfab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:00:59 user nova-compute[75113]: No targets found.
Oct 26 17:00:59 user nova-compute[75113]: iSNS:
Oct 26 17:00:59 user nova-compute[75113]: No targets found.
Oct 26 17:00:59 user nova-compute[75113]: STATIC:
Oct 26 17:00:59 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08
Oct 26 17:00:59 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:00:59 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:00:59 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00
Oct 26 17:00:59 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:00:59 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:00:59 user nova-compute[75113]: FIRMWARE:
Oct 26 17:00:59 user nova-compute[75113]: No targets found.
Oct 26 17:00:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:00:59 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:00:59 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG nova.network.neutron [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3657c3-3c68-4016-a871-781d708251ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[478382a1-872d-4f99-8e90-96bb1b4b47f1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 17:00:59 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 17:00:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 17:00:59 user nova-compute[75113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 (non-flash)
Oct 26 17:00:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914288430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08'): ({'sdc'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Removing single pathed devices sdc {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "cafa9881-242a-4275-8125-80f415d56ee8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "cafa9881-242a-4275-8125-80f415d56ee8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "cafa9881-242a-4275-8125-80f415d56ee8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "cafa9881-242a-4275-8125-80f415d56ee8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "cafa9881-242a-4275-8125-80f415d56ee8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.043s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a2c372-ec08-4100-8703-736a77cf9080]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:59 user nova-compute[75113]: INFO nova.compute.manager [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Terminating instance
Oct 26 17:00:59 user nova-compute[75113]: DEBUG nova.compute.manager [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3a40ea-8aa5-47e8-88a7-54fef0ed8e64]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Flushing IO for device /dev/sdc {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53f55ca-e667-4439-8b61-6298a24edd4f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e31baea-0124-484a-bb39-193f83be7cbd]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b51c25f-b56e-451c-8e7c-3b5a5e201f7f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[40196541-3bc1-48f0-83b4-5d9e68475527]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08, portal: 172.16.0.220,3260]
Oct 26 17:00:59 user nova-compute[75113]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08, portal: 172.16.0.220,3260] successful.
Oct 26 17:00:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92367020-5467-406a-bff3-0089938acf08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[002984af-ab3d-40c5-bf28-c309b1f3363e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] <== disconnect_volume: return (430ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:00:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Skipping network cache update for instance because it is being deleted. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Skipping network cache update for instance because it is Building. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Skipping network cache update for instance because it is Building. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 645deae0-4c03-41d0-aa3b-daa79ed25425 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.network.neutron [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] Releasing lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-changed-fe1957f9-f87b-4d7b-98f9-425e92dbd68d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing instance network info cache due to event network-changed-fe1957f9-f87b-4d7b-98f9-425e92dbd68d. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] Acquiring lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] Acquired lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.network.neutron [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing network info cache for port fe1957f9-f87b-4d7b-98f9-425e92dbd68d {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:01:00 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Instance destroyed successfully.
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.objects.instance [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lazy-loading 'resources' on Instance uuid cafa9881-242a-4275-8125-80f415d56ee8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2076590787',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2076590787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2076590',id=11,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjTM4xnfW1L39yh4ENtMY8vNabyrzDFVSkNLIg0LSeYrJFDWNZz77x+arwkJf6QSghM194dqaazcw1zjlSPtB/0Ddd0RrwBI4TX7FoGwFF249gJy+QThjE4IR0sbG+FcQ==',key_name='tempest-keypair-1930011595',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f527bb82a1c45f08faded8f87750026',ramdisk_id='',reservation_id='r-libp0vzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2136726404',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:57:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce0a834257344abb3dd5718ece6e46e',uuid=cafa9881-242a-4275-8125-80f415d56ee8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "address": "fa:16:3e:fd:e6:f5", "network": {"id": "2fb896f7-d8a7-49a5-a9ee-90da1afff111", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-610632337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f527bb82a1c45f08faded8f87750026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b6c1aa-2d", "ovs_interfaceid": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Converting VIF {"id": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "address": "fa:16:3e:fd:e6:f5", "network": {"id": "2fb896f7-d8a7-49a5-a9ee-90da1afff111", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-610632337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f527bb82a1c45f08faded8f87750026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b6c1aa-2d", "ovs_interfaceid": "c7b6c1aa-2d23-4be9-add7-b54f42557d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e6:f5,bridge_name='br-int',has_traffic_filtering=True,id=c7b6c1aa-2d23-4be9-add7-b54f42557d05,network=Network(2fb896f7-d8a7-49a5-a9ee-90da1afff111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b6c1aa-2d') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG os_vif [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e6:f5,bridge_name='br-int',has_traffic_filtering=True,id=c7b6c1aa-2d23-4be9-add7-b54f42557d05,network=Network(2fb896f7-d8a7-49a5-a9ee-90da1afff111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b6c1aa-2d') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.network.neutron [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7b6c1aa-2d, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3d6d741-15a2-4b54-8f01-9cf71db506d3) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:01:00 user nova-compute[75113]: INFO os_vif [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e6:f5,bridge_name='br-int',has_traffic_filtering=True,id=c7b6c1aa-2d23-4be9-add7-b54f42557d05,network=Network(2fb896f7-d8a7-49a5-a9ee-90da1afff111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b6c1aa-2d')
Oct 26 17:01:00 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Deleting instance files /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8_del
Oct 26 17:01:00 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Deletion of /opt/stack/data/nova/instances/cafa9881-242a-4275-8125-80f415d56ee8_del complete
Oct 26 17:01:00 user nova-compute[75113]: INFO nova.compute.manager [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 26 17:01:00 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: cafa9881-242a-4275-8125-80f415d56ee8] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating instance_info_cache with network_info: [{"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-645deae0-4c03-41d0-aa3b-daa79ed25425" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:01:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.network.neutron [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9c8c4b0c-7987-404f-a5a5-3e3f7a74d38a req-fdf971f4-029d-4dc8-adf6-35e3bd6490cd service nova] Releasing lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Successfully updated port: 037fd8ce-526b-4c04-bd17-4402781e28ed {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-changed-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing instance network info cache due to event network-changed-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] Acquiring lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] Acquired lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.network.neutron [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing network info cache for port 1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-9b542495-bc57-43f6-9924-6d883f6dc833 req-71d45e7f-e710-4b5e-ae6f-7f58b0381b8d service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Received event network-vif-plugged-c56a7bab-9148-426a-8c9f-960a14205cb2 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9b542495-bc57-43f6-9924-6d883f6dc833 req-71d45e7f-e710-4b5e-ae6f-7f58b0381b8d service nova] Acquiring lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9b542495-bc57-43f6-9924-6d883f6dc833 req-71d45e7f-e710-4b5e-ae6f-7f58b0381b8d service nova] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9b542495-bc57-43f6-9924-6d883f6dc833 req-71d45e7f-e710-4b5e-ae6f-7f58b0381b8d service nova] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-9b542495-bc57-43f6-9924-6d883f6dc833 req-71d45e7f-e710-4b5e-ae6f-7f58b0381b8d service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] No waiting events found dispatching network-vif-plugged-c56a7bab-9148-426a-8c9f-960a14205cb2 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:01:01 user nova-compute[75113]: WARNING nova.compute.manager [req-9b542495-bc57-43f6-9924-6d883f6dc833 req-71d45e7f-e710-4b5e-ae6f-7f58b0381b8d service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Received unexpected event network-vif-plugged-c56a7bab-9148-426a-8c9f-960a14205cb2 for instance with vm_state building and task_state spawning.
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:01:01 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Instance spawned successfully.
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.network.neutron [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:01:01 user nova-compute[75113]: INFO nova.compute.manager [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Took 8.43 seconds to spawn the instance on the hypervisor.
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:01:01 user nova-compute[75113]: INFO nova.compute.manager [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Took 9.52 seconds to build instance.
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:01 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Took 1.14 seconds to deallocate network for instance.
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b7a81898-8e6c-4a15-b1d1-56c607f588d2 tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.678s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.050s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:01 user nova-compute[75113]: INFO nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-4194d932-92c9-4faa-a8e2-31d6eca1237d req-1bc61630-022d-402d-bded-d4ff29cc769f service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Received event network-vif-deleted-c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:01 user nova-compute[75113]: INFO nova.compute.manager [req-4194d932-92c9-4faa-a8e2-31d6eca1237d req-1bc61630-022d-402d-bded-d4ff29cc769f service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Neutron deleted interface c7b6c1aa-2d23-4be9-add7-b54f42557d05; detaching it from the instance and deleting it from the info cache
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.network.neutron [req-4194d932-92c9-4faa-a8e2-31d6eca1237d req-1bc61630-022d-402d-bded-d4ff29cc769f service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-4194d932-92c9-4faa-a8e2-31d6eca1237d req-1bc61630-022d-402d-bded-d4ff29cc769f service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Detach interface failed, port_id=c7b6c1aa-2d23-4be9-add7-b54f42557d05, reason: Instance cafa9881-242a-4275-8125-80f415d56ee8 could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.network.neutron [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] Releasing lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Received event network-vif-unplugged-c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] Acquiring lock "cafa9881-242a-4275-8125-80f415d56ee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] Lock "cafa9881-242a-4275-8125-80f415d56ee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] Lock "cafa9881-242a-4275-8125-80f415d56ee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] No waiting events found dispatching network-vif-unplugged-c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Received event network-vif-unplugged-c7b6c1aa-2d23-4be9-add7-b54f42557d05 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Received event network-vif-plugged-c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] Acquiring lock "cafa9881-242a-4275-8125-80f415d56ee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] Lock "cafa9881-242a-4275-8125-80f415d56ee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] Lock "cafa9881-242a-4275-8125-80f415d56ee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] No waiting events found dispatching network-vif-plugged-c7b6c1aa-2d23-4be9-add7-b54f42557d05 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:01:01 user nova-compute[75113]: WARNING nova.compute.manager [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: cafa9881-242a-4275-8125-80f415d56ee8] Received unexpected event network-vif-plugged-c7b6c1aa-2d23-4be9-add7-b54f42557d05 for instance with vm_state active and task_state deleting.
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-changed-037fd8ce-526b-4c04-bd17-4402781e28ed {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing instance network info cache due to event network-changed-037fd8ce-526b-4c04-bd17-4402781e28ed. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:01:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] Acquiring lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] Acquired lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG nova.network.neutron [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing network info cache for port 037fd8ce-526b-4c04-bd17-4402781e28ed {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG nova.network.neutron [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.120s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG nova.network.neutron [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:02 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Deleted allocations for instance cafa9881-242a-4275-8125-80f415d56ee8
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-04173bcd-e82e-4cb3-b2c9-f9c1f4982be6 req-96feab2e-005f-40d1-bf8f-edb133f1f4e7 service nova] Releasing lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Successfully updated port: 5c34234e-daf0-44a0-8c1c-94721e415e19 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquired lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48005998-ea40-4f2c-ae5c-92df12ae52a1 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404 tempest-TestServerVolumeAttachScenarioOldVersion-2136726404-project-member] Lock "cafa9881-242a-4275-8125-80f415d56ee8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.985s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-4bc98f5f-e447-4b76-ab79-6b543308bb0b req-952260a9-24b6-472c-8f6b-6394290fad09 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-changed-5c34234e-daf0-44a0-8c1c-94721e415e19 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-4bc98f5f-e447-4b76-ab79-6b543308bb0b req-952260a9-24b6-472c-8f6b-6394290fad09 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing instance network info cache due to event network-changed-5c34234e-daf0-44a0-8c1c-94721e415e19. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4bc98f5f-e447-4b76-ab79-6b543308bb0b req-952260a9-24b6-472c-8f6b-6394290fad09 service nova] Acquiring lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Starting finish_revert_migration {{(pid=75113) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Start _get_guest_xml network_info=[{"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd8eabd44-e46f-4fe2-bc1f-3fc3bf813852', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAOpQCYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '645deae0-4c03-41d0-aa3b-daa79ed25425', 'attached_at': '2023-10-26T17:01:04.000000', 'detached_at': '', 'volume_id': 'd2af05ff-ba68-4321-b9b9-b5cf9a720bad', 'serial': 'd2af05ff-ba68-4321-b9b9-b5cf9a720bad'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:01:03 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:01:03 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.objects.instance [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lazy-loading 'vcpu_model' on Instance uuid 645deae0-4c03-41d0-aa3b-daa79ed25425 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-817b5d6c-3be5-410c-9b9d-35270d69be32 req-feebb6e3-45f0-41c7-90cc-0fbeaca34939 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Received event network-changed-a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-817b5d6c-3be5-410c-9b9d-35270d69be32 req-feebb6e3-45f0-41c7-90cc-0fbeaca34939 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Refreshing instance network info cache due to event network-changed-a1aedd8d-1f49-4949-9e8e-d1800971fd0f. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-817b5d6c-3be5-410c-9b9d-35270d69be32 req-feebb6e3-45f0-41c7-90cc-0fbeaca34939 service nova] Acquiring lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-817b5d6c-3be5-410c-9b9d-35270d69be32 req-feebb6e3-45f0-41c7-90cc-0fbeaca34939 service nova] Acquired lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:01:03 user nova-compute[75113]: DEBUG nova.network.neutron [req-817b5d6c-3be5-410c-9b9d-35270d69be32 req-feebb6e3-45f0-41c7-90cc-0fbeaca34939 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Refreshing network info cache for port a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAOpQCYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:01:04 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:01:04 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:01:04 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daa3927-3772-46b4-8719-1942014f07dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:01:04 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[06414e0f-2ce8-419f-a6ba-30b9fa3d9515]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad] added
Oct 26 17:01:04 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cc1f40-3057-4892-b74d-168e4dd67151]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5794266-6f24-4654-a78d-c1f4957b5b26]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAOpQCYZ {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAOpQCYZ" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3b1117-5ac8-457b-86cd-32faea076b4e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UAOpQCYZ'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e59938a-385e-4c5b-8df5-2375b19c217c]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5d55c2-3f2b-4ccd-9630-463cb7958dee]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 17:01:04 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 17:01:04 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e814fdf1-5652-425e-9aa6-4e70b1311f17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260]
Oct 26 17:01:04 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260] successful.
Oct 26 17:01:04 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbaa5c4-dde1-4211-9b0b-6656f2c70fe9]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeec19c-93d9-466c-a418-614ced81a2b0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 17:01:04 user nova-compute[75113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:01:04 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 17:01:04 user nova-compute[75113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:01:04 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba2f103-0dd3-4e08-bba2-59ede990ac7c]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG nova.network.neutron [req-817b5d6c-3be5-410c-9b9d-35270d69be32 req-feebb6e3-45f0-41c7-90cc-0fbeaca34939 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updated VIF entry in instance network info cache for port a1aedd8d-1f49-4949-9e8e-d1800971fd0f. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG nova.network.neutron [req-817b5d6c-3be5-410c-9b9d-35270d69be32 req-feebb6e3-45f0-41c7-90cc-0fbeaca34939 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updating instance_info_cache with network_info: [{"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-817b5d6c-3be5-410c-9b9d-35270d69be32 req-feebb6e3-45f0-41c7-90cc-0fbeaca34939 service nova] Releasing lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAOpQCYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23335323038623037', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335323038623037', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1163194343',display_name='tempest-ServerActionsTestOtherB-server-1163194343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1163194343',id=2,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNi6S0kdc5pWvhxq2azP5QRonb6qXMUiteND1nfP3Uf2jZWYfGzWg8fbqOsk4PAj062T9NqyLIEevO2i2GpMs0q5myp5A+SX7ogwodc86c3yyzOTm1sjFsenkun5EW0fg==',key_name='tempest-keypair-1305775717',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:59:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='992a6be3e5814c3b80c705763af5de1e',ramdisk_id='',reservation_id='r-fvz5sf1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1008157220',owner_user_name='tempest-ServerActionsTestOtherB-1008157220-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f45ddba3b44d1b9333b282e43b02e8',uuid=645deae0-4c03-41d0-aa3b-daa79ed25425,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converting VIF {"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:01:05 user nova-compute[75113]:   <uuid>645deae0-4c03-41d0-aa3b-daa79ed25425</uuid>
Oct 26 17:01:05 user nova-compute[75113]:   <name>instance-00000002</name>
Oct 26 17:01:05 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:01:05 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:01:05 user nova-compute[75113]:   <metadata>
Oct 26 17:01:05 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:01:05 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:01:05 user nova-compute[75113]:       <nova:name>tempest-ServerActionsTestOtherB-server-1163194343</nova:name>
Oct 26 17:01:05 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:01:03</nova:creationTime>
Oct 26 17:01:05 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:01:05 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:01:05 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:01:05 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:01:05 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:01:05 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:01:05 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:01:05 user nova-compute[75113]:       <nova:owner>
Oct 26 17:01:05 user nova-compute[75113]:         <nova:user uuid="38f45ddba3b44d1b9333b282e43b02e8">tempest-ServerActionsTestOtherB-1008157220-project-member</nova:user>
Oct 26 17:01:05 user nova-compute[75113]:         <nova:project uuid="992a6be3e5814c3b80c705763af5de1e">tempest-ServerActionsTestOtherB-1008157220</nova:project>
Oct 26 17:01:05 user nova-compute[75113]:       </nova:owner>
Oct 26 17:01:05 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:01:05 user nova-compute[75113]:       <nova:ports>
Oct 26 17:01:05 user nova-compute[75113]:         <nova:port uuid="96d708f7-00f7-44af-9bc6-43882921ea03">
Oct 26 17:01:05 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 17:01:05 user nova-compute[75113]:         </nova:port>
Oct 26 17:01:05 user nova-compute[75113]:       </nova:ports>
Oct 26 17:01:05 user nova-compute[75113]:     </nova:instance>
Oct 26 17:01:05 user nova-compute[75113]:   </metadata>
Oct 26 17:01:05 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:01:05 user nova-compute[75113]:     <system>
Oct 26 17:01:05 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:01:05 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:01:05 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:01:05 user nova-compute[75113]:       <entry name="serial">645deae0-4c03-41d0-aa3b-daa79ed25425</entry>
Oct 26 17:01:05 user nova-compute[75113]:       <entry name="uuid">645deae0-4c03-41d0-aa3b-daa79ed25425</entry>
Oct 26 17:01:05 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:01:05 user nova-compute[75113]:     </system>
Oct 26 17:01:05 user nova-compute[75113]:   </sysinfo>
Oct 26 17:01:05 user nova-compute[75113]:   <os>
Oct 26 17:01:05 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:01:05 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:01:05 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:01:05 user nova-compute[75113]:   </os>
Oct 26 17:01:05 user nova-compute[75113]:   <features>
Oct 26 17:01:05 user nova-compute[75113]:     <acpi/>
Oct 26 17:01:05 user nova-compute[75113]:     <apic/>
Oct 26 17:01:05 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:01:05 user nova-compute[75113]:   </features>
Oct 26 17:01:05 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:01:05 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:01:05 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:01:05 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:01:05 user nova-compute[75113]:   </clock>
Oct 26 17:01:05 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:01:05 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:01:05 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:01:05 user nova-compute[75113]:   </cpu>
Oct 26 17:01:05 user nova-compute[75113]:   <devices>
Oct 26 17:01:05 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:01:05 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:01:05 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk"/>
Oct 26 17:01:05 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:01:05 user nova-compute[75113]:     </disk>
Oct 26 17:01:05 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:01:05 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:01:05 user nova-compute[75113]:       <source dev="/dev/sdb"/>
Oct 26 17:01:05 user nova-compute[75113]:       <target dev="vdb" bus="virtio"/>
Oct 26 17:01:05 user nova-compute[75113]:       <serial>d2af05ff-ba68-4321-b9b9-b5cf9a720bad</serial>
Oct 26 17:01:05 user nova-compute[75113]:     </disk>
Oct 26 17:01:05 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:01:05 user nova-compute[75113]:       <mac address="fa:16:3e:0e:ed:4e"/>
Oct 26 17:01:05 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:01:05 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:01:05 user nova-compute[75113]:       <target dev="tap96d708f7-00"/>
Oct 26 17:01:05 user nova-compute[75113]:     </interface>
Oct 26 17:01:05 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:01:05 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/console.log" append="off"/>
Oct 26 17:01:05 user nova-compute[75113]:     </serial>
Oct 26 17:01:05 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:01:05 user nova-compute[75113]:     <video>
Oct 26 17:01:05 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:01:05 user nova-compute[75113]:     </video>
Oct 26 17:01:05 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:01:05 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:01:05 user nova-compute[75113]:     </rng>
Oct 26 17:01:05 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:01:05 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:01:05 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:01:05 user nova-compute[75113]:     </memballoon>
Oct 26 17:01:05 user nova-compute[75113]:   </devices>
Oct 26 17:01:05 user nova-compute[75113]: </domain>
Oct 26 17:01:05 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1163194343',display_name='tempest-ServerActionsTestOtherB-server-1163194343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1163194343',id=2,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNi6S0kdc5pWvhxq2azP5QRonb6qXMUiteND1nfP3Uf2jZWYfGzWg8fbqOsk4PAj062T9NqyLIEevO2i2GpMs0q5myp5A+SX7ogwodc86c3yyzOTm1sjFsenkun5EW0fg==',key_name='tempest-keypair-1305775717',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:59:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='992a6be3e5814c3b80c705763af5de1e',ramdisk_id='',reservation_id='r-fvz5sf1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1008157220',owner_user_name='tempest-ServerActionsTestOtherB-1008157220-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f45ddba3b44d1b9333b282e43b02e8',uuid=645deae0-4c03-41d0-aa3b-daa79ed25425,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converting VIF {"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_vif [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:01:05 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69ed2396-a603-4c84-a66b-7b474523b68e is timed out.
Oct 26 17:01:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac662543-30ce-5fd8-bd5e-0ffbbb41a931', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Successfully detached device vdb from instance 69ed2396-a603-4c84-a66b-7b474523b68e from the live domain config.
Oct 26 17:01:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96d708f7-00, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96d708f7-00, col_values=(('qos', UUID('bf51f854-c129-403f-9c75-8c5034a5630e')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96d708f7-00, col_values=(('external_ids', {'iface-id': '96d708f7-00f7-44af-9bc6-43882921ea03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:ed:4e', 'vm-uuid': '645deae0-4c03-41d0-aa3b-daa79ed25425'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXqImyNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:01:05 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:01:05 user nova-compute[75113]: INFO os_vif [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00')
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc84eb6e-bd8e-4723-9c07-0966ae9d7c2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:01:05 user nova-compute[75113]: No targets found.
Oct 26 17:01:05 user nova-compute[75113]: iSNS:
Oct 26 17:01:05 user nova-compute[75113]: No targets found.
Oct 26 17:01:05 user nova-compute[75113]: STATIC:
Oct 26 17:01:05 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad
Oct 26 17:01:05 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:01:05 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:01:05 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00
Oct 26 17:01:05 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:01:05 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:01:05 user nova-compute[75113]: FIRMWARE:
Oct 26 17:01:05 user nova-compute[75113]: No targets found.
Oct 26 17:01:05 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:01:05 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:01:05 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3f6d7f-10cf-4368-9305-8fc7b9682876]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e105b5-6052-44be-8636-1d4b8d1e8ec5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 17:01:05 user nova-compute[75113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:01:05 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 (non-flash)
Oct 26 17:01:05 user nova-compute[75113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:01:05 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914144430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00'): ({'sde'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Removing single pathed devices sde {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[be30bca2-563d-476b-9999-7f7391c4b2a0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[db85751a-bdbc-4973-8b09-c7d7e70b5a88]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Flushing IO for device /dev/sde {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d816600-e427-423d-924c-ee2374250bd0]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1a4454-7d12-409b-85fd-07605790cd6f]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b59911-76a2-4adb-ab1a-4629c9c4f922]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0aad31c-718d-44f0-a712-94f4c910aeba]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00, portal: 172.16.0.220,3260]
Oct 26 17:01:05 user nova-compute[75113]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00, portal: 172.16.0.220,3260] successful.
Oct 26 17:01:05 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80806a8c-ae83-411e-b575-f4ccb122db00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a279a5b-762d-4127-8016-2fec2a0362e4]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-0dca2902-6282-4a51-bbec-6306eba13df5 req-58267fa3-3ace-4413-a590-a3600f1b3fa9 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0dca2902-6282-4a51-bbec-6306eba13df5 req-58267fa3-3ace-4413-a590-a3600f1b3fa9 service nova] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0dca2902-6282-4a51-bbec-6306eba13df5 req-58267fa3-3ace-4413-a590-a3600f1b3fa9 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0dca2902-6282-4a51-bbec-6306eba13df5 req-58267fa3-3ace-4413-a590-a3600f1b3fa9 service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-0dca2902-6282-4a51-bbec-6306eba13df5 req-58267fa3-3ace-4413-a590-a3600f1b3fa9 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] No waiting events found dispatching network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:01:10 user nova-compute[75113]: WARNING nova.compute.manager [req-0dca2902-6282-4a51-bbec-6306eba13df5 req-58267fa3-3ace-4413-a590-a3600f1b3fa9 service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received unexpected event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 for instance with vm_state resized and task_state resize_reverting.
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-24b32dcd-dcd6-465a-9e42-8d5714293fbf req-e4d3067f-23d1-411c-9c01-fca470ed9fdc service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-24b32dcd-dcd6-465a-9e42-8d5714293fbf req-e4d3067f-23d1-411c-9c01-fca470ed9fdc service nova] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-24b32dcd-dcd6-465a-9e42-8d5714293fbf req-e4d3067f-23d1-411c-9c01-fca470ed9fdc service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-24b32dcd-dcd6-465a-9e42-8d5714293fbf req-e4d3067f-23d1-411c-9c01-fca470ed9fdc service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-24b32dcd-dcd6-465a-9e42-8d5714293fbf req-e4d3067f-23d1-411c-9c01-fca470ed9fdc service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] No waiting events found dispatching network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:01:10 user nova-compute[75113]: WARNING nova.compute.manager [req-24b32dcd-dcd6-465a-9e42-8d5714293fbf req-e4d3067f-23d1-411c-9c01-fca470ed9fdc service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received unexpected event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 for instance with vm_state resized and task_state resize_reverting.
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 4.600s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] <== disconnect_volume: return (4601ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:01:10 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Instance running successfully.
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] finish_revert_migration finished successfully. {{(pid=75113) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 26 17:01:10 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:01:10 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7784MB free_disk=25.19676971435547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating instance_info_cache with network_info: [{"id": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "address": "fa:16:3e:62:67:cf", "network": {"id": "e7216aad-39cb-4142-8c1f-dce1020dcc12", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-111571776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cf0eba-47", "ovs_interfaceid": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "address": "fa:16:3e:de:4c:5a", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa8c9bd5-e4", "ovs_interfaceid": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "address": "fa:16:3e:6f:10:8d", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eaa7ff-68", "ovs_interfaceid": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "address": "fa:16:3e:54:87:08", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1957f9-f8", "ovs_interfaceid": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "address": "fa:16:3e:03:49:9c", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfb2aba-69", "ovs_interfaceid": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "037fd8ce-526b-4c04-bd17-4402781e28ed", "address": "fa:16:3e:d2:0b:83", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037fd8ce-52", "ovs_interfaceid": "037fd8ce-526b-4c04-bd17-4402781e28ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c34234e-daf0-44a0-8c1c-94721e415e19", "address": "fa:16:3e:e2:4b:a1", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c34234e-da", "ovs_interfaceid": "5c34234e-daf0-44a0-8c1c-94721e415e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Releasing lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Instance network_info: |[{"id": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "address": "fa:16:3e:62:67:cf", "network": {"id": "e7216aad-39cb-4142-8c1f-dce1020dcc12", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-111571776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cf0eba-47", "ovs_interfaceid": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "address": "fa:16:3e:de:4c:5a", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa8c9bd5-e4", "ovs_interfaceid": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "address": "fa:16:3e:6f:10:8d", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eaa7ff-68", "ovs_interfaceid": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "address": "fa:16:3e:54:87:08", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1957f9-f8", "ovs_interfaceid": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "address": "fa:16:3e:03:49:9c", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfb2aba-69", "ovs_interfaceid": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "037fd8ce-526b-4c04-bd17-4402781e28ed", "address": "fa:16:3e:d2:0b:83", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037fd8ce-52", "ovs_interfaceid": "037fd8ce-526b-4c04-bd17-4402781e28ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c34234e-daf0-44a0-8c1c-94721e415e19", "address": "fa:16:3e:e2:4b:a1", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c34234e-da", "ovs_interfaceid": "5c34234e-daf0-44a0-8c1c-94721e415e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4bc98f5f-e447-4b76-ab79-6b543308bb0b req-952260a9-24b6-472c-8f6b-6394290fad09 service nova] Acquired lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.network.neutron [req-4bc98f5f-e447-4b76-ab79-6b543308bb0b req-952260a9-24b6-472c-8f6b-6394290fad09 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing network info cache for port 5c34234e-daf0-44a0-8c1c-94721e415e19 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 69ed2396-a603-4c84-a66b-7b474523b68e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance f1769d95-897b-4e83-89ba-c486aa086dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fbf1e605-91c5-4188-9081-f9762ad92a9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 645deae0-4c03-41d0-aa3b-daa79ed25425 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 76039e5a-db02-48b4-81eb-a7383d1374b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance dd051355-efa5-40a9-a1fc-89ddb87c456e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.network.neutron [req-4bc98f5f-e447-4b76-ab79-6b543308bb0b req-952260a9-24b6-472c-8f6b-6394290fad09 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updated VIF entry in instance network info cache for port 5c34234e-daf0-44a0-8c1c-94721e415e19. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG nova.network.neutron [req-4bc98f5f-e447-4b76-ab79-6b543308bb0b req-952260a9-24b6-472c-8f6b-6394290fad09 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating instance_info_cache with network_info: [{"id": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "address": "fa:16:3e:62:67:cf", "network": {"id": "e7216aad-39cb-4142-8c1f-dce1020dcc12", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-111571776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cf0eba-47", "ovs_interfaceid": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "address": "fa:16:3e:de:4c:5a", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa8c9bd5-e4", "ovs_interfaceid": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "address": "fa:16:3e:6f:10:8d", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eaa7ff-68", "ovs_interfaceid": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "address": "fa:16:3e:54:87:08", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1957f9-f8", "ovs_interfaceid": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "address": "fa:16:3e:03:49:9c", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfb2aba-69", "ovs_interfaceid": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "037fd8ce-526b-4c04-bd17-4402781e28ed", "address": "fa:16:3e:d2:0b:83", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037fd8ce-52", "ovs_interfaceid": "037fd8ce-526b-4c04-bd17-4402781e28ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c34234e-daf0-44a0-8c1c-94721e415e19", "address": "fa:16:3e:e2:4b:a1", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c34234e-da", "ovs_interfaceid": "5c34234e-daf0-44a0-8c1c-94721e415e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4bc98f5f-e447-4b76-ab79-6b543308bb0b req-952260a9-24b6-472c-8f6b-6394290fad09 service nova] Releasing lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:11 user nova-compute[75113]: DEBUG nova.objects.instance [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lazy-loading 'flavor' on Instance uuid 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:01:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bb71d67b-a301-4ebd-8a27-ad9b07e6f38f tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "69ed2396-a603-4c84-a66b-7b474523b68e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.442s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "69ed2396-a603-4c84-a66b-7b474523b68e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.417s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "69ed2396-a603-4c84-a66b-7b474523b68e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:11 user nova-compute[75113]: INFO nova.compute.manager [None req-ff86e738-ebcc-495f-89b4-e0014b2c7937 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating instance to original state: 'active'
Oct 26 17:01:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:11 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:01:11 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:01:11 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:01:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:12 user nova-compute[75113]: DEBUG nova.objects.instance [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'flavor' on Instance uuid 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:01:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:12 user nova-compute[75113]: INFO nova.compute.manager [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Attaching volume c0274fd0-61fa-4d16-a99a-c91310ce3597 to /dev/vdb
Oct 26 17:01:13 user nova-compute[75113]: DEBUG os_brick.utils [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82e1b9d-5da3-4107-8832-163214f0f400]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2371a16-833f-4c6e-ade2-2ad31f321e1b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c1849e-579e-43f0-a95c-446637fcf71d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f764cf48-ab60-4a54-851c-862e18843dec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:01:13 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:01:13 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dc4f77-b19c-4940-a1a2-ea7ed6f19f5a]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG os_brick.utils [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:01:13 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updating existing volume attachment record: 3300649c-da70-4357-9202-fba84fd3e864 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:01:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:01:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:18 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:01:18 user nova-compute[75113]: INFO nova.compute.claims [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Claim successful on node user
Oct 26 17:01:19 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:01:19 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:01:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.941s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:01:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:01:19 user nova-compute[75113]: DEBUG nova.network.neutron [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:01:19 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:01:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:01:19 user nova-compute[75113]: DEBUG nova.policy [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c431350f06fd4dbf8d74835f34626ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae5d124cb054dfbbe04433a685903bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:01:19 user nova-compute[75113]: INFO nova.virt.block_device [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Booting with blank volume at /dev/vda
Oct 26 17:01:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:20 user nova-compute[75113]: DEBUG nova.network.neutron [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Successfully created port: 2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:01:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:20 user nova-compute[75113]: DEBUG nova.objects.instance [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lazy-loading 'flavor' on Instance uuid fbf1e605-91c5-4188-9081-f9762ad92a9f {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:01:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d9b79cec-d035-4fd6-9a3e-7c90439d1409 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 41.968s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 24.991s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Successfully updated port: 2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquired lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-d88ae315-2e83-4c86-8aa1-caf3e3213e2e req-434954b9-6adb-4d3d-850f-721bd9a530a5 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-changed-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-d88ae315-2e83-4c86-8aa1-caf3e3213e2e req-434954b9-6adb-4d3d-850f-721bd9a530a5 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Refreshing instance network info cache due to event network-changed-2f8541b1-74e9-4dd3-ad25-bcf31b21f605. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d88ae315-2e83-4c86-8aa1-caf3e3213e2e req-434954b9-6adb-4d3d-850f-721bd9a530a5 service nova] Acquiring lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:01:21 user nova-compute[75113]: INFO nova.virt.block_device [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Booting with volume 302b2aca-51b0-49c5-a4f9-7dbc9530e05b at /dev/vdb
Oct 26 17:01:21 user nova-compute[75113]: DEBUG os_brick.utils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[837054a5-d4b8-4ad2-b9a9-29642af9b306]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe9019f-0537-4c75-8b1a-7f0d0058ee73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Updating instance_info_cache with network_info: [{"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Releasing lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG nova.compute.manager [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Instance network_info: |[{"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d88ae315-2e83-4c86-8aa1-caf3e3213e2e req-434954b9-6adb-4d3d-850f-721bd9a530a5 service nova] Acquired lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG nova.network.neutron [req-d88ae315-2e83-4c86-8aa1-caf3e3213e2e req-434954b9-6adb-4d3d-850f-721bd9a530a5 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Refreshing network info cache for port 2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[74acf1a8-1aea-4cc4-8b01-7b02eba5bdde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dc94f3-a2c9-4fc3-8f76-d9218a650ff9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:01:21 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe78239-6305-4814-8945-487a4bfc1622]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG os_brick.utils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating existing volume attachment record: b22ec249-f9cd-4e51-b4f7-912d33dd4892 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG nova.network.neutron [req-d88ae315-2e83-4c86-8aa1-caf3e3213e2e req-434954b9-6adb-4d3d-850f-721bd9a530a5 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Updated VIF entry in instance network info cache for port 2f8541b1-74e9-4dd3-ad25-bcf31b21f605. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG nova.network.neutron [req-d88ae315-2e83-4c86-8aa1-caf3e3213e2e req-434954b9-6adb-4d3d-850f-721bd9a530a5 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Updating instance_info_cache with network_info: [{"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d88ae315-2e83-4c86-8aa1-caf3e3213e2e req-434954b9-6adb-4d3d-850f-721bd9a530a5 service nova] Releasing lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG os_brick.utils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5ef04f-091c-4ba4-9553-de5ca7e22181]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[186ede45-f287-4966-8a1f-48b02c2db137]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a50e05-ce8f-4c04-985a-f9b3d820670a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d833c5af-0751-4112-9f9e-af92c1f9738f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:01:26 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:01:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8abde1-e2de-49ab-9388-23c916470c67]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG os_brick.utils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:01:26 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Updating existing volume attachment record: 2f1ad302-72c7-4b02-83bd-fc6203adf815 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:01:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYXwaZAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:01:33 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:01:33 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:01:33 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3546eb46-2765-4466-ba11-ad7437588009]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:01:33 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad41e46-3748-4677-a5f4-472ad9ef0f45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597] added
Oct 26 17:01:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ae2134-f8ef-454a-8e59-25d94a255404]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f47849-6980-4cac-8666-bafb0201741e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYXwaZAh {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYXwaZAh" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b2ceba-b5df-41ef-a42c-6d370f228dbd]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oYXwaZAh'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9ad154-350d-4361-86ab-902054cd00e8]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8c089c-d625-42db-acc9-d70fc8a50cea]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:01:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:01:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe44b2a-7f2f-4241-92d1-cfba65fbdcdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260]
Oct 26 17:01:33 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260] successful.
Oct 26 17:01:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.086s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8847a822-c39b-4ab4-a28e-ecbbd04c648f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f908a8-ac8e-45c6-b3d2-1fc04286beb0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:01:33 user nova-compute[75113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:01:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:01:33 user nova-compute[75113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:01:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9077648c-6533-4eed-96af-f14fb1546d5e]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYXwaZAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:33 user nova-compute[75113]: INFO nova.compute.manager [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Terminating instance
Oct 26 17:01:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-f4300d27-0e2e-430b-b934-0c988637751d req-37ce9609-e197-421b-b9f5-f8792deff7ae service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Received event network-vif-unplugged-02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f4300d27-0e2e-430b-b934-0c988637751d req-37ce9609-e197-421b-b9f5-f8792deff7ae service nova] Acquiring lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f4300d27-0e2e-430b-b934-0c988637751d req-37ce9609-e197-421b-b9f5-f8792deff7ae service nova] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f4300d27-0e2e-430b-b934-0c988637751d req-37ce9609-e197-421b-b9f5-f8792deff7ae service nova] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-f4300d27-0e2e-430b-b934-0c988637751d req-37ce9609-e197-421b-b9f5-f8792deff7ae service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] No waiting events found dispatching network-vif-unplugged-02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-f4300d27-0e2e-430b-b934-0c988637751d req-37ce9609-e197-421b-b9f5-f8792deff7ae service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Received event network-vif-unplugged-02278050-c73c-493a-83c4-095f43697e9f for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:01:34 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Instance destroyed successfully.
Oct 26 17:01:34 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lazy-loading 'resources' on Instance uuid fbf1e605-91c5-4188-9081-f9762ad92a9f {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-937411519',display_name='tempest-TestVolumeSwap-server-937411519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-937411519',id=6,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv7/sgXZqMFiyaj1arm45b3jX/OsP+apDV4SSiN1UIafxjPoXasxYmUUT5wpq+MoV6DCiCRCI48AR/t69UQgeS+pSfiMRt9rjfOK3aRD6TpTsgxZw9GILYQNbmkLQz7Cw==',key_name='tempest-keypair-1863371864',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ee6a73f02e54d7fa20bbe92d986f577',ramdisk_id='',reservation_id='r-q4cyljb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-576420899',owner_user_name='tempest-TestVolumeSwap-576420899-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:54:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7cbd5018fe6453095388366e914a5d1',uuid=fbf1e605-91c5-4188-9081-f9762ad92a9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02278050-c73c-493a-83c4-095f43697e9f", "address": "fa:16:3e:dc:3d:4b", "network": {"id": "04d9fbd9-4ccd-424a-ac46-2324eac68387", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1918515909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee6a73f02e54d7fa20bbe92d986f577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02278050-c7", "ovs_interfaceid": "02278050-c73c-493a-83c4-095f43697e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Converting VIF {"id": "02278050-c73c-493a-83c4-095f43697e9f", "address": "fa:16:3e:dc:3d:4b", "network": {"id": "04d9fbd9-4ccd-424a-ac46-2324eac68387", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1918515909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee6a73f02e54d7fa20bbe92d986f577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02278050-c7", "ovs_interfaceid": "02278050-c73c-493a-83c4-095f43697e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3d:4b,bridge_name='br-int',has_traffic_filtering=True,id=02278050-c73c-493a-83c4-095f43697e9f,network=Network(04d9fbd9-4ccd-424a-ac46-2324eac68387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02278050-c7') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG os_vif [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3d:4b,bridge_name='br-int',has_traffic_filtering=True,id=02278050-c73c-493a-83c4-095f43697e9f,network=Network(04d9fbd9-4ccd-424a-ac46-2324eac68387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02278050-c7') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02278050-c7, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d98a1f37-458e-4a70-8c54-f05867da7c3e) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:34 user nova-compute[75113]: INFO os_vif [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3d:4b,bridge_name='br-int',has_traffic_filtering=True,id=02278050-c73c-493a-83c4-095f43697e9f,network=Network(04d9fbd9-4ccd-424a-ac46-2324eac68387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02278050-c7')
Oct 26 17:01:34 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Deleting instance files /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f_del
Oct 26 17:01:34 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Deletion of /opt/stack/data/nova/instances/fbf1e605-91c5-4188-9081-f9762ad92a9f_del complete
Oct 26 17:01:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '23762313830343237', 'path': '/dev/sdc'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762313830343237', 'path': '/dev/sdc'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG nova.objects.instance [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'flavor' on Instance uuid 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:01:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:01:34 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:01:34 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:01:34 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:01:34 user nova-compute[75113]:   <serial>c0274fd0-61fa-4d16-a99a-c91310ce3597</serial>
Oct 26 17:01:34 user nova-compute[75113]: </disk>
Oct 26 17:01:34 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:01:35 user nova-compute[75113]: INFO nova.compute.manager [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Took 1.07 seconds to destroy the instance on the hypervisor.
Oct 26 17:01:35 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] No VIF found with MAC fa:16:3e:e8:74:98, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "69ed2396-a603-4c84-a66b-7b474523b68e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "69ed2396-a603-4c84-a66b-7b474523b68e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:35 user nova-compute[75113]: INFO nova.compute.manager [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Terminating instance
Oct 26 17:01:35 user nova-compute[75113]: DEBUG nova.compute.manager [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-18e78c5d-21c1-4738-9a99-ee48981d695c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.641s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:36 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Took 1.12 seconds to deallocate network for instance.
Oct 26 17:01:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:36 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Instance destroyed successfully.
Oct 26 17:01:36 user nova-compute[75113]: DEBUG nova.objects.instance [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lazy-loading 'resources' on Instance uuid 69ed2396-a603-4c84-a66b-7b474523b68e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1913117266',display_name='tempest-ServerStableDeviceRescueTest-server-1913117266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1913117266',id=3,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW+UVAaeZhsHcgJPMCTV2xrTl4CNLS+MkerMjXHgsZ/82ki6sNGkNDlnGa3RyBILee0xpxEsN4D9jct3D9FBDbCeR7Aa5wxdczxapjdNt9OslE9CMc4aivD8gDSXppcbA==',key_name='tempest-keypair-522693316',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:58:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='992dea425f6241c2b94c1a1c970cb028',ramdisk_id='',reservation_id='r-3xgua6lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-205046583',owner_user_name='tempest-ServerStableDeviceRescueTest-205046583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:00:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='289e367da4e444a791a556dafb7ec392',uuid=69ed2396-a603-4c84-a66b-7b474523b68e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Converting VIF {"id": "0502d8bd-666e-4f27-8c38-e060b44ce264", "address": "fa:16:3e:bf:13:99", "network": {"id": "0cce3e7a-230f-426f-9807-14feb9122e9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-291235395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992dea425f6241c2b94c1a1c970cb028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0502d8bd-66", "ovs_interfaceid": "0502d8bd-666e-4f27-8c38-e060b44ce264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:13:99,bridge_name='br-int',has_traffic_filtering=True,id=0502d8bd-666e-4f27-8c38-e060b44ce264,network=Network(0cce3e7a-230f-426f-9807-14feb9122e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0502d8bd-66') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG os_vif [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:13:99,bridge_name='br-int',has_traffic_filtering=True,id=0502d8bd-666e-4f27-8c38-e060b44ce264,network=Network(0cce3e7a-230f-426f-9807-14feb9122e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0502d8bd-66') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-6587c6a9-a871-48d2-943b-ae976372b0cc req-65f1aab4-bdfb-4dcc-b824-6351605c5fbf service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Received event network-vif-plugged-02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6587c6a9-a871-48d2-943b-ae976372b0cc req-65f1aab4-bdfb-4dcc-b824-6351605c5fbf service nova] Acquiring lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6587c6a9-a871-48d2-943b-ae976372b0cc req-65f1aab4-bdfb-4dcc-b824-6351605c5fbf service nova] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6587c6a9-a871-48d2-943b-ae976372b0cc req-65f1aab4-bdfb-4dcc-b824-6351605c5fbf service nova] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-6587c6a9-a871-48d2-943b-ae976372b0cc req-65f1aab4-bdfb-4dcc-b824-6351605c5fbf service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] No waiting events found dispatching network-vif-plugged-02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:01:36 user nova-compute[75113]: WARNING nova.compute.manager [req-6587c6a9-a871-48d2-943b-ae976372b0cc req-65f1aab4-bdfb-4dcc-b824-6351605c5fbf service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Received unexpected event network-vif-plugged-02278050-c73c-493a-83c4-095f43697e9f for instance with vm_state deleted and task_state None.
Oct 26 17:01:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-6587c6a9-a871-48d2-943b-ae976372b0cc req-65f1aab4-bdfb-4dcc-b824-6351605c5fbf service nova] [instance: fbf1e605-91c5-4188-9081-f9762ad92a9f] Received event network-vif-deleted-02278050-c73c-493a-83c4-095f43697e9f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0502d8bd-66, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22ee2a65-a93f-4687-b2fe-d4757e925358) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:36 user nova-compute[75113]: INFO os_vif [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:13:99,bridge_name='br-int',has_traffic_filtering=True,id=0502d8bd-666e-4f27-8c38-e060b44ce264,network=Network(0cce3e7a-230f-426f-9807-14feb9122e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0502d8bd-66')
Oct 26 17:01:36 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Deleting instance files /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e_del
Oct 26 17:01:36 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Deletion of /opt/stack/data/nova/instances/69ed2396-a603-4c84-a66b-7b474523b68e_del complete
Oct 26 17:01:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:36 user nova-compute[75113]: INFO nova.compute.manager [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 26 17:01:36 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:01:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.561s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:36 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Deleted allocations for instance fbf1e605-91c5-4188-9081-f9762ad92a9f
Oct 26 17:01:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2423e42f-dd66-4f3a-93b1-02b74f1b1536 tempest-TestVolumeSwap-576420899 tempest-TestVolumeSwap-576420899-project-member] Lock "fbf1e605-91c5-4188-9081-f9762ad92a9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:37 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:37 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Took 1.32 seconds to deallocate network for instance.
Oct 26 17:01:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:38 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:01:38 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:01:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:38 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Deleted allocations for instance 69ed2396-a603-4c84-a66b-7b474523b68e
Oct 26 17:01:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-9d0343fa-1b5b-4f05-9f74-0d8574feee38 req-42c28888-dac3-45c4-b7f5-57b6ee1873bd service nova] [instance: 69ed2396-a603-4c84-a66b-7b474523b68e] Received event network-vif-deleted-0502d8bd-666e-4f27-8c38-e060b44ce264 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf16a8d6-2a6a-484d-b55d-14b5c8edab6b tempest-ServerStableDeviceRescueTest-205046583 tempest-ServerStableDeviceRescueTest-205046583-project-member] Lock "69ed2396-a603-4c84-a66b-7b474523b68e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.981s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "f1769d95-897b-4e83-89ba-c486aa086dc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "f1769d95-897b-4e83-89ba-c486aa086dc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:44 user nova-compute[75113]: INFO nova.compute.manager [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Terminating instance
Oct 26 17:01:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:01:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:45 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Instance destroyed successfully.
Oct 26 17:01:45 user nova-compute[75113]: DEBUG nova.objects.instance [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lazy-loading 'resources' on Instance uuid f1769d95-897b-4e83-89ba-c486aa086dc1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1556194533',display_name='tempest-VolumesAdminNegativeTest-server-1556194533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1556194533',id=4,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmZFeWrEnHR9BsSaIACkxRo9vJSoEocr4pXNFSOhDA84ka5b4vV0OYnGZ1ugAGWwLgRH1P/JMK832RdxTsXk1ZQsF72seCCUk/Lf3tBAzMyjy/8h6VFWg5DeT03DpfQHQ==',key_name='tempest-keypair-1355933924',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:54:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66ee9d2be45d4517a2cfea00177b1c15',ramdisk_id='',reservation_id='r-mxu9sz7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1147285819',owner_user_name='tempest-VolumesAdminNegativeTest-1147285819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:54:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9ca04a69e784bc38c31b5ca256d3a94',uuid=f1769d95-897b-4e83-89ba-c486aa086dc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "address": "fa:16:3e:54:a8:27", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af075bf-d8", "ovs_interfaceid": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Converting VIF {"id": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "address": "fa:16:3e:54:a8:27", "network": {"id": "7544701f-9799-4ffc-8459-26502eebc126", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-450459947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ee9d2be45d4517a2cfea00177b1c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af075bf-d8", "ovs_interfaceid": "8af075bf-d8dd-478d-9f83-3faf420bc6c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:a8:27,bridge_name='br-int',has_traffic_filtering=True,id=8af075bf-d8dd-478d-9f83-3faf420bc6c6,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8af075bf-d8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG os_vif [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:a8:27,bridge_name='br-int',has_traffic_filtering=True,id=8af075bf-d8dd-478d-9f83-3faf420bc6c6,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8af075bf-d8') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8af075bf-d8, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbdb1d23-d797-4f78-b8ac-c476ecddbc26) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:01:45 user nova-compute[75113]: INFO os_vif [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:a8:27,bridge_name='br-int',has_traffic_filtering=True,id=8af075bf-d8dd-478d-9f83-3faf420bc6c6,network=Network(7544701f-9799-4ffc-8459-26502eebc126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8af075bf-d8')
Oct 26 17:01:45 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Deleting instance files /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1_del
Oct 26 17:01:45 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Deletion of /opt/stack/data/nova/instances/f1769d95-897b-4e83-89ba-c486aa086dc1_del complete
Oct 26 17:01:45 user nova-compute[75113]: INFO nova.compute.manager [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 26 17:01:45 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:01:45 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:46 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Took 0.80 seconds to deallocate network for instance.
Oct 26 17:01:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-aaa91e30-1517-4582-ae87-7a7967887c79 req-14b0cbce-444e-416a-be32-c5dd0900e263 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Received event network-vif-deleted-8af075bf-d8dd-478d-9f83-3faf420bc6c6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:46 user nova-compute[75113]: INFO nova.compute.manager [req-aaa91e30-1517-4582-ae87-7a7967887c79 req-14b0cbce-444e-416a-be32-c5dd0900e263 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Neutron deleted interface 8af075bf-d8dd-478d-9f83-3faf420bc6c6; detaching it from the instance and deleting it from the info cache
Oct 26 17:01:46 user nova-compute[75113]: DEBUG nova.network.neutron [req-aaa91e30-1517-4582-ae87-7a7967887c79 req-14b0cbce-444e-416a-be32-c5dd0900e263 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-aaa91e30-1517-4582-ae87-7a7967887c79 req-14b0cbce-444e-416a-be32-c5dd0900e263 service nova] [instance: f1769d95-897b-4e83-89ba-c486aa086dc1] Detach interface failed, port_id=8af075bf-d8dd-478d-9f83-3faf420bc6c6, reason: Instance f1769d95-897b-4e83-89ba-c486aa086dc1 could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Acquiring lock "a2bbd45c-c153-408c-ba58-2f161963989e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "a2bbd45c-c153-408c-ba58-2f161963989e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:01:46 user nova-compute[75113]: INFO nova.compute.claims [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Claim successful on node user
Oct 26 17:01:46 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Deleted allocations for instance f1769d95-897b-4e83-89ba-c486aa086dc1
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-434dae70-61e1-49b3-8136-4169d84de8db tempest-VolumesAdminNegativeTest-1147285819 tempest-VolumesAdminNegativeTest-1147285819-project-member] Lock "f1769d95-897b-4e83-89ba-c486aa086dc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.476s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG nova.network.neutron [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:01:47 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:01:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG nova.policy [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4dd2483aed9547feaa14f83b05f27a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd231966ad7514ad387c1976bf2d97416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:01:47 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Creating image(s)
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "/opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "/opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.190s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.190s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk 1073741824" returned: 0 in 0.052s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Successfully created port: 3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Cannot resize image /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Ensure instance console log exists: /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Successfully updated port: 3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Acquiring lock "refresh_cache-a2bbd45c-c153-408c-ba58-2f161963989e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Acquired lock "refresh_cache-a2bbd45c-c153-408c-ba58-2f161963989e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-12e0aa87-078a-49a8-86f8-715216d641d5 req-330d2848-87b0-44a4-8cbf-b32af49be56e service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Received event network-changed-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-12e0aa87-078a-49a8-86f8-715216d641d5 req-330d2848-87b0-44a4-8cbf-b32af49be56e service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Refreshing instance network info cache due to event network-changed-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-12e0aa87-078a-49a8-86f8-715216d641d5 req-330d2848-87b0-44a4-8cbf-b32af49be56e service nova] Acquiring lock "refresh_cache-a2bbd45c-c153-408c-ba58-2f161963989e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:01:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Updating instance_info_cache with network_info: [{"id": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "address": "fa:16:3e:41:1e:cf", "network": {"id": "7e3cb9cc-c0e9-4479-a6e1-4969e18b1554", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424467201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d231966ad7514ad387c1976bf2d97416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d49e1ab-39", "ovs_interfaceid": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Releasing lock "refresh_cache-a2bbd45c-c153-408c-ba58-2f161963989e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Instance network_info: |[{"id": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "address": "fa:16:3e:41:1e:cf", "network": {"id": "7e3cb9cc-c0e9-4479-a6e1-4969e18b1554", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424467201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d231966ad7514ad387c1976bf2d97416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d49e1ab-39", "ovs_interfaceid": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-12e0aa87-078a-49a8-86f8-715216d641d5 req-330d2848-87b0-44a4-8cbf-b32af49be56e service nova] Acquired lock "refresh_cache-a2bbd45c-c153-408c-ba58-2f161963989e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.network.neutron [req-12e0aa87-078a-49a8-86f8-715216d641d5 req-330d2848-87b0-44a4-8cbf-b32af49be56e service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Refreshing network info cache for port 3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Start _get_guest_xml network_info=[{"id": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "address": "fa:16:3e:41:1e:cf", "network": {"id": "7e3cb9cc-c0e9-4479-a6e1-4969e18b1554", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424467201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d231966ad7514ad387c1976bf2d97416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d49e1ab-39", "ovs_interfaceid": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:01:49 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:01:49 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-750716619',display_name='tempest-VolumesActionsTest-instance-750716619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-750716619',id=19,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d231966ad7514ad387c1976bf2d97416',ramdisk_id='',reservation_id='r-93ds0dmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1136981146',owner_user_name='tempest-VolumesActionsTest-1136981146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:01:47Z,user_data=None,user_id='4dd2483aed9547feaa14f83b05f27a23',uuid=a2bbd45c-c153-408c-ba58-2f161963989e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "address": "fa:16:3e:41:1e:cf", "network": {"id": "7e3cb9cc-c0e9-4479-a6e1-4969e18b1554", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424467201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d231966ad7514ad387c1976bf2d97416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d49e1ab-39", "ovs_interfaceid": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Converting VIF {"id": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "address": "fa:16:3e:41:1e:cf", "network": {"id": "7e3cb9cc-c0e9-4479-a6e1-4969e18b1554", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424467201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d231966ad7514ad387c1976bf2d97416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d49e1ab-39", "ovs_interfaceid": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:1e:cf,bridge_name='br-int',has_traffic_filtering=True,id=3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8,network=Network(7e3cb9cc-c0e9-4479-a6e1-4969e18b1554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d49e1ab-39') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.objects.instance [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lazy-loading 'pci_devices' on Instance uuid a2bbd45c-c153-408c-ba58-2f161963989e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:01:49 user nova-compute[75113]:   <uuid>a2bbd45c-c153-408c-ba58-2f161963989e</uuid>
Oct 26 17:01:49 user nova-compute[75113]:   <name>instance-00000013</name>
Oct 26 17:01:49 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:01:49 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:01:49 user nova-compute[75113]:   <metadata>
Oct 26 17:01:49 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:01:49 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:01:49 user nova-compute[75113]:       <nova:name>tempest-VolumesActionsTest-instance-750716619</nova:name>
Oct 26 17:01:49 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:01:49</nova:creationTime>
Oct 26 17:01:49 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:01:49 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:01:49 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:01:49 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:01:49 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:01:49 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:01:49 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:01:49 user nova-compute[75113]:       <nova:owner>
Oct 26 17:01:49 user nova-compute[75113]:         <nova:user uuid="4dd2483aed9547feaa14f83b05f27a23">tempest-VolumesActionsTest-1136981146-project-member</nova:user>
Oct 26 17:01:49 user nova-compute[75113]:         <nova:project uuid="d231966ad7514ad387c1976bf2d97416">tempest-VolumesActionsTest-1136981146</nova:project>
Oct 26 17:01:49 user nova-compute[75113]:       </nova:owner>
Oct 26 17:01:49 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:01:49 user nova-compute[75113]:       <nova:ports>
Oct 26 17:01:49 user nova-compute[75113]:         <nova:port uuid="3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8">
Oct 26 17:01:49 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 17:01:49 user nova-compute[75113]:         </nova:port>
Oct 26 17:01:49 user nova-compute[75113]:       </nova:ports>
Oct 26 17:01:49 user nova-compute[75113]:     </nova:instance>
Oct 26 17:01:49 user nova-compute[75113]:   </metadata>
Oct 26 17:01:49 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:01:49 user nova-compute[75113]:     <system>
Oct 26 17:01:49 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:01:49 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:01:49 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:01:49 user nova-compute[75113]:       <entry name="serial">a2bbd45c-c153-408c-ba58-2f161963989e</entry>
Oct 26 17:01:49 user nova-compute[75113]:       <entry name="uuid">a2bbd45c-c153-408c-ba58-2f161963989e</entry>
Oct 26 17:01:49 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:01:49 user nova-compute[75113]:     </system>
Oct 26 17:01:49 user nova-compute[75113]:   </sysinfo>
Oct 26 17:01:49 user nova-compute[75113]:   <os>
Oct 26 17:01:49 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:01:49 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:01:49 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:01:49 user nova-compute[75113]:   </os>
Oct 26 17:01:49 user nova-compute[75113]:   <features>
Oct 26 17:01:49 user nova-compute[75113]:     <acpi/>
Oct 26 17:01:49 user nova-compute[75113]:     <apic/>
Oct 26 17:01:49 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:01:49 user nova-compute[75113]:   </features>
Oct 26 17:01:49 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:01:49 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:01:49 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:01:49 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:01:49 user nova-compute[75113]:   </clock>
Oct 26 17:01:49 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:01:49 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:01:49 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:01:49 user nova-compute[75113]:   </cpu>
Oct 26 17:01:49 user nova-compute[75113]:   <devices>
Oct 26 17:01:49 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:01:49 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:01:49 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk"/>
Oct 26 17:01:49 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:01:49 user nova-compute[75113]:     </disk>
Oct 26 17:01:49 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:01:49 user nova-compute[75113]:       <mac address="fa:16:3e:41:1e:cf"/>
Oct 26 17:01:49 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:01:49 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:01:49 user nova-compute[75113]:       <target dev="tap3d49e1ab-39"/>
Oct 26 17:01:49 user nova-compute[75113]:     </interface>
Oct 26 17:01:49 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:01:49 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/console.log" append="off"/>
Oct 26 17:01:49 user nova-compute[75113]:     </serial>
Oct 26 17:01:49 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:01:49 user nova-compute[75113]:     <video>
Oct 26 17:01:49 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:01:49 user nova-compute[75113]:     </video>
Oct 26 17:01:49 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:01:49 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:01:49 user nova-compute[75113]:     </rng>
Oct 26 17:01:49 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:01:49 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:01:49 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:01:49 user nova-compute[75113]:     </memballoon>
Oct 26 17:01:49 user nova-compute[75113]:   </devices>
Oct 26 17:01:49 user nova-compute[75113]: </domain>
Oct 26 17:01:49 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-750716619',display_name='tempest-VolumesActionsTest-instance-750716619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-750716619',id=19,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d231966ad7514ad387c1976bf2d97416',ramdisk_id='',reservation_id='r-93ds0dmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1136981146',owner_user_name='tempest-VolumesActionsTest-1136981146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:01:47Z,user_data=None,user_id='4dd2483aed9547feaa14f83b05f27a23',uuid=a2bbd45c-c153-408c-ba58-2f161963989e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "address": "fa:16:3e:41:1e:cf", "network": {"id": "7e3cb9cc-c0e9-4479-a6e1-4969e18b1554", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424467201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d231966ad7514ad387c1976bf2d97416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d49e1ab-39", "ovs_interfaceid": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Converting VIF {"id": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "address": "fa:16:3e:41:1e:cf", "network": {"id": "7e3cb9cc-c0e9-4479-a6e1-4969e18b1554", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424467201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d231966ad7514ad387c1976bf2d97416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d49e1ab-39", "ovs_interfaceid": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:1e:cf,bridge_name='br-int',has_traffic_filtering=True,id=3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8,network=Network(7e3cb9cc-c0e9-4479-a6e1-4969e18b1554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d49e1ab-39') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG os_vif [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:1e:cf,bridge_name='br-int',has_traffic_filtering=True,id=3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8,network=Network(7e3cb9cc-c0e9-4479-a6e1-4969e18b1554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d49e1ab-39') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b5cf494-64bf-5833-b7ee-75350d7ecf63', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d49e1ab-39, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d49e1ab-39, col_values=(('qos', UUID('5e330f97-56eb-4f2a-b8b5-28af98ccc6d1')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d49e1ab-39, col_values=(('external_ids', {'iface-id': '3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:1e:cf', 'vm-uuid': 'a2bbd45c-c153-408c-ba58-2f161963989e'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:49 user nova-compute[75113]: INFO os_vif [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:1e:cf,bridge_name='br-int',has_traffic_filtering=True,id=3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8,network=Network(7e3cb9cc-c0e9-4479-a6e1-4969e18b1554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d49e1ab-39')
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] No VIF found with MAC fa:16:3e:41:1e:cf, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.network.neutron [req-12e0aa87-078a-49a8-86f8-715216d641d5 req-330d2848-87b0-44a4-8cbf-b32af49be56e service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Updated VIF entry in instance network info cache for port 3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.network.neutron [req-12e0aa87-078a-49a8-86f8-715216d641d5 req-330d2848-87b0-44a4-8cbf-b32af49be56e service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Updating instance_info_cache with network_info: [{"id": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "address": "fa:16:3e:41:1e:cf", "network": {"id": "7e3cb9cc-c0e9-4479-a6e1-4969e18b1554", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424467201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d231966ad7514ad387c1976bf2d97416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d49e1ab-39", "ovs_interfaceid": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-12e0aa87-078a-49a8-86f8-715216d641d5 req-330d2848-87b0-44a4-8cbf-b32af49be56e service nova] Releasing lock "refresh_cache-a2bbd45c-c153-408c-ba58-2f161963989e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-1652ffdb-f4ec-4d1e-950e-b0191c8195f8 req-8a63f80b-ba87-44af-9da1-f9b693bf1f02 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-changed-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-1652ffdb-f4ec-4d1e-950e-b0191c8195f8 req-8a63f80b-ba87-44af-9da1-f9b693bf1f02 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Refreshing instance network info cache due to event network-changed-ff980165-116a-431e-90a0-3a1d98b79b9d. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1652ffdb-f4ec-4d1e-950e-b0191c8195f8 req-8a63f80b-ba87-44af-9da1-f9b693bf1f02 service nova] Acquiring lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1652ffdb-f4ec-4d1e-950e-b0191c8195f8 req-8a63f80b-ba87-44af-9da1-f9b693bf1f02 service nova] Acquired lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:01:49 user nova-compute[75113]: DEBUG nova.network.neutron [req-1652ffdb-f4ec-4d1e-950e-b0191c8195f8 req-8a63f80b-ba87-44af-9da1-f9b693bf1f02 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Refreshing network info cache for port ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:01:50 user nova-compute[75113]: DEBUG nova.network.neutron [req-1652ffdb-f4ec-4d1e-950e-b0191c8195f8 req-8a63f80b-ba87-44af-9da1-f9b693bf1f02 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updated VIF entry in instance network info cache for port ff980165-116a-431e-90a0-3a1d98b79b9d. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:01:50 user nova-compute[75113]: DEBUG nova.network.neutron [req-1652ffdb-f4ec-4d1e-950e-b0191c8195f8 req-8a63f80b-ba87-44af-9da1-f9b693bf1f02 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updating instance_info_cache with network_info: [{"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1652ffdb-f4ec-4d1e-950e-b0191c8195f8 req-8a63f80b-ba87-44af-9da1-f9b693bf1f02 service nova] Releasing lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-6d0ba919-37c2-403e-9aa1-fbdd6d81e027 req-099e1769-6186-4156-8b4d-9fe06ecd8f6d service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Received event network-vif-plugged-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6d0ba919-37c2-403e-9aa1-fbdd6d81e027 req-099e1769-6186-4156-8b4d-9fe06ecd8f6d service nova] Acquiring lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6d0ba919-37c2-403e-9aa1-fbdd6d81e027 req-099e1769-6186-4156-8b4d-9fe06ecd8f6d service nova] Lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6d0ba919-37c2-403e-9aa1-fbdd6d81e027 req-099e1769-6186-4156-8b4d-9fe06ecd8f6d service nova] Lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-6d0ba919-37c2-403e-9aa1-fbdd6d81e027 req-099e1769-6186-4156-8b4d-9fe06ecd8f6d service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] No waiting events found dispatching network-vif-plugged-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:01:51 user nova-compute[75113]: WARNING nova.compute.manager [req-6d0ba919-37c2-403e-9aa1-fbdd6d81e027 req-099e1769-6186-4156-8b4d-9fe06ecd8f6d service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Received unexpected event network-vif-plugged-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 for instance with vm_state building and task_state spawning.
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:01:53 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Instance spawned successfully.
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:01:53 user nova-compute[75113]: INFO nova.compute.manager [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Took 6.22 seconds to spawn the instance on the hypervisor.
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Received event network-vif-plugged-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] Acquiring lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] Lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] Lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] No waiting events found dispatching network-vif-plugged-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:01:53 user nova-compute[75113]: WARNING nova.compute.manager [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Received unexpected event network-vif-plugged-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 for instance with vm_state building and task_state spawning.
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-changed-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Refreshing instance network info cache due to event network-changed-ff980165-116a-431e-90a0-3a1d98b79b9d. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] Acquiring lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] Acquired lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:01:53 user nova-compute[75113]: DEBUG nova.network.neutron [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Refreshing network info cache for port ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:01:53 user nova-compute[75113]: INFO nova.compute.manager [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Took 6.95 seconds to build instance.
Oct 26 17:01:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-554b9572-396c-4794-9707-388ac606b184 tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "a2bbd45c-c153-408c-ba58-2f161963989e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.071s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:01:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:55 user nova-compute[75113]: DEBUG nova.network.neutron [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updated VIF entry in instance network info cache for port ff980165-116a-431e-90a0-3a1d98b79b9d. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:01:55 user nova-compute[75113]: DEBUG nova.network.neutron [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updating instance_info_cache with network_info: [{"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:01:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-da733f6f-6dd2-465b-9bad-38b6f86c9632 req-fbd5b540-7a2c-42fd-bc77-e4cc75bf32d7 service nova] Releasing lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:01:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:01:59 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:02:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:02:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:02:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:02:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:02:00 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:02:00 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Updating instance_info_cache with network_info: [{"id": "de147975-aa0e-4028-af5f-a92993f17b8f", "address": "fa:16:3e:47:99:24", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde147975-aa", "ovs_interfaceid": "de147975-aa0e-4028-af5f-a92993f17b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:02:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:02:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:02:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:02:01 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:02:01 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:02:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:02 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:02:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:02 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:02:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:02 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:02:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:02:05 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:02:05 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7830MB free_disk=25.36103057861328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 645deae0-4c03-41d0-aa3b-daa79ed25425 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 76039e5a-db02-48b4-81eb-a7383d1374b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance dd051355-efa5-40a9-a1fc-89ddb87c456e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance a2bbd45c-c153-408c-ba58-2f161963989e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:05 user nova-compute[75113]: INFO nova.compute.manager [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Rebooting instance
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquired lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:02:05 user nova-compute[75113]: DEBUG nova.network.neutron [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG nova.network.neutron [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updating instance_info_cache with network_info: [{"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Releasing lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-6ef74cca-a699-4b87-8587-73e90fb6bca6 req-704d6db0-bb01-4a11-b264-117f2b2934e8 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-vif-unplugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6ef74cca-a699-4b87-8587-73e90fb6bca6 req-704d6db0-bb01-4a11-b264-117f2b2934e8 service nova] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6ef74cca-a699-4b87-8587-73e90fb6bca6 req-704d6db0-bb01-4a11-b264-117f2b2934e8 service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6ef74cca-a699-4b87-8587-73e90fb6bca6 req-704d6db0-bb01-4a11-b264-117f2b2934e8 service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-6ef74cca-a699-4b87-8587-73e90fb6bca6 req-704d6db0-bb01-4a11-b264-117f2b2934e8 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] No waiting events found dispatching network-vif-unplugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:06 user nova-compute[75113]: WARNING nova.compute.manager [req-6ef74cca-a699-4b87-8587-73e90fb6bca6 req-704d6db0-bb01-4a11-b264-117f2b2934e8 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received unexpected event network-vif-unplugged-ff980165-116a-431e-90a0-3a1d98b79b9d for instance with vm_state active and task_state reboot_started_hard.
Oct 26 17:02:07 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Instance destroyed successfully.
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'resources' on Instance uuid 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1982662822',display_name='tempest-TestMinimumBasicScenario-server-1982662822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1982662822',id=15,image_ref='0521c00f-82dc-45d4-8764-d12668ce2240',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9WGXEXrBv1HHrw/BahosIMiFehiyfTzuTP5JS60S6ifc+z3JAckDUJ8DH1IMfHJttIi9rYDvL4URf4GCDY6zxa1JU9fTzpckEU87gTgbFD+aLdpBaRRzDKuYiuSf0lnQ==',key_name='tempest-TestMinimumBasicScenario-1651364451',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:59:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd0d356ed9284735abb524c73c143e3b',ramdisk_id='',reservation_id='r-4nvn6z1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0521c00f-82dc-45d4-8764-d12668ce2240',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1757884343',owner_user_name='tempest-TestMinimumBasicScenario-1757884343-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:02:07Z,user_data=None,user_id='25d708e692104c63ac2e25531e82d734',uuid=57a1b1df-ced1-4df2-8714-9aaa5f3c7e36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converting VIF {"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_vif [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff980165-11, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b7087df-a8e3-489c-8c9f-a489552b10f0) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:07 user nova-compute[75113]: INFO os_vif [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11')
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYXwaZAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:02:07 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1bedb5-6c48-4f24-95b7-d39eda134f09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:02:07 user nova-compute[75113]: No targets found.
Oct 26 17:02:07 user nova-compute[75113]: iSNS:
Oct 26 17:02:07 user nova-compute[75113]: No targets found.
Oct 26 17:02:07 user nova-compute[75113]: STATIC:
Oct 26 17:02:07 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597
Oct 26 17:02:07 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:02:07 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:02:07 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad
Oct 26 17:02:07 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:02:07 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:02:07 user nova-compute[75113]: FIRMWARE:
Oct 26 17:02:07 user nova-compute[75113]: No targets found.
Oct 26 17:02:07 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:02:07 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:02:07 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eec8618-2f23-487e-9dff-41bb9d370120]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab57e3e7-86dd-4f69-ad0b-7bf2c082f32b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:07 user nova-compute[75113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:07 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:07 user nova-compute[75113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:07 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914145360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597'): ({'sdc'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Removing single pathed devices sdc {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cdebbe-9676-4c95-b885-23c175374f5c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcd870c-bb4a-4b0e-b469-e566f30a56eb]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Flushing IO for device /dev/sdc {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff03bab-1205-485b-9b7d-f0162d553acb]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f37902-a68c-462e-b107-a95973933d2f]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.092s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29786f4-5592-4f35-a171-01b2ef4af62d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[113d6729-b2fb-45c6-8332-9a532eaa6352]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260]
Oct 26 17:02:07 user nova-compute[75113]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260] successful.
Oct 26 17:02:07 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b96434-1ff8-4d8c-bd85-0c39e534a175]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] <== disconnect_volume: return (381ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Start _get_guest_xml network_info=[{"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0521c00f-82dc-45d4-8764-d12668ce2240,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '0521c00f-82dc-45d4-8764-d12668ce2240'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3300649c-da70-4357-9202-fba84fd3e864', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYXwaZAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '57a1b1df-ced1-4df2-8714-9aaa5f3c7e36', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0274fd0-61fa-4d16-a99a-c91310ce3597', 'serial': 'c0274fd0-61fa-4d16-a99a-c91310ce3597'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:02:07 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:02:07 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0521c00f-82dc-45d4-8764-d12668ce2240,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'vcpu_model' on Instance uuid 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.objects.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Object Instance<57a1b1df-ced1-4df2-8714-9aaa5f3c7e36> lazy-loaded attributes: resources,vcpu_model {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYXwaZAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:02:07 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:02:07 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:02:07 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc9ec87-c47d-402b-82a0-f4bd0af6b14a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:02:07 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6aba34-93d5-4663-81a5-f9499c4389b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597] added
Oct 26 17:02:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[714723ba-8589-480f-a49c-50c66c38c4d2]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b98feb-3d09-47fb-9075-f6912c91b020]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYXwaZAh {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYXwaZAh" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ffca3a-9e89-43c5-89e3-f9903a18ac6e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oYXwaZAh'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[448d7a4c-0e87-4eed-83b3-952172d7481d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a8fda3-efec-427c-b71a-4e9514c708b8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c42c178-e1ca-461e-82ba-7334aa2f5007]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260]
Oct 26 17:02:08 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260] successful.
Oct 26 17:02:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c1364e-53ad-40b7-a0c8-cafbe77de9aa]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66790fb-9c58-45e2-94d2-2d5877dc54af]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:08 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:08 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25deaab-aacc-483c-ba2b-90b91fcdddbf]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:02:08 user nova-compute[75113]: INFO nova.virt.block_device [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Booting with volume b438bcd2-60a0-476e-9af3-a729a27dc3f4 at /dev/vdc
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.utils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b33f36-72c8-41d9-9052-a81944d2a543]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37ffbdc-4ca1-4abd-be9b-0d6a26b1fb8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b801af-62b5-4829-8e3a-9ec4b8ee01c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b7bf53-ed59-4f90-b369-69e6e253bf75]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:02:08 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb2ea5b-40c0-42e0-80fc-214bb020ef95]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG os_brick.utils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating existing volume attachment record: d7b1b109-04ba-47e5-b079-f9e744a07aeb {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG nova.compute.manager [req-a38c3462-50a0-48a5-9690-aff253ce6a58 req-2bd10fdf-5679-4185-9f99-8f68491bf94f service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a38c3462-50a0-48a5-9690-aff253ce6a58 req-2bd10fdf-5679-4185-9f99-8f68491bf94f service nova] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a38c3462-50a0-48a5-9690-aff253ce6a58 req-2bd10fdf-5679-4185-9f99-8f68491bf94f service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a38c3462-50a0-48a5-9690-aff253ce6a58 req-2bd10fdf-5679-4185-9f99-8f68491bf94f service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:08 user nova-compute[75113]: DEBUG nova.compute.manager [req-a38c3462-50a0-48a5-9690-aff253ce6a58 req-2bd10fdf-5679-4185-9f99-8f68491bf94f service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] No waiting events found dispatching network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:08 user nova-compute[75113]: WARNING nova.compute.manager [req-a38c3462-50a0-48a5-9690-aff253ce6a58 req-2bd10fdf-5679-4185-9f99-8f68491bf94f service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received unexpected event network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d for instance with vm_state active and task_state reboot_started_hard.
Oct 26 17:02:09 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYXwaZAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23762313830343237', 'path': '/dev/sdc'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762313830343237', 'path': '/dev/sdc'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1982662822',display_name='tempest-TestMinimumBasicScenario-server-1982662822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1982662822',id=15,image_ref='0521c00f-82dc-45d4-8764-d12668ce2240',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9WGXEXrBv1HHrw/BahosIMiFehiyfTzuTP5JS60S6ifc+z3JAckDUJ8DH1IMfHJttIi9rYDvL4URf4GCDY6zxa1JU9fTzpckEU87gTgbFD+aLdpBaRRzDKuYiuSf0lnQ==',key_name='tempest-TestMinimumBasicScenario-1651364451',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:59:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd0d356ed9284735abb524c73c143e3b',ramdisk_id='',reservation_id='r-4nvn6z1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0521c00f-82dc-45d4-8764-d12668ce2240',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1757884343',owner_user_name='tempest-TestMinimumBasicScenario-1757884343-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:02:07Z,user_data=None,user_id='25d708e692104c63ac2e25531e82d734',uuid=57a1b1df-ced1-4df2-8714-9aaa5f3c7e36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converting VIF {"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'pci_devices' on Instance uuid 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG nova.objects.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Object Instance<57a1b1df-ced1-4df2-8714-9aaa5f3c7e36> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:02:09 user nova-compute[75113]:   <uuid>57a1b1df-ced1-4df2-8714-9aaa5f3c7e36</uuid>
Oct 26 17:02:09 user nova-compute[75113]:   <name>instance-0000000f</name>
Oct 26 17:02:09 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:02:09 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:02:09 user nova-compute[75113]:   <metadata>
Oct 26 17:02:09 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:02:09 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:02:09 user nova-compute[75113]:       <nova:name>tempest-TestMinimumBasicScenario-server-1982662822</nova:name>
Oct 26 17:02:09 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:02:07</nova:creationTime>
Oct 26 17:02:09 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:02:09 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:02:09 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:02:09 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:02:09 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:02:09 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:02:09 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:02:09 user nova-compute[75113]:       <nova:owner>
Oct 26 17:02:09 user nova-compute[75113]:         <nova:user uuid="25d708e692104c63ac2e25531e82d734">tempest-TestMinimumBasicScenario-1757884343-project-member</nova:user>
Oct 26 17:02:09 user nova-compute[75113]:         <nova:project uuid="dd0d356ed9284735abb524c73c143e3b">tempest-TestMinimumBasicScenario-1757884343</nova:project>
Oct 26 17:02:09 user nova-compute[75113]:       </nova:owner>
Oct 26 17:02:09 user nova-compute[75113]:       <nova:root type="image" uuid="0521c00f-82dc-45d4-8764-d12668ce2240"/>
Oct 26 17:02:09 user nova-compute[75113]:       <nova:ports>
Oct 26 17:02:09 user nova-compute[75113]:         <nova:port uuid="ff980165-116a-431e-90a0-3a1d98b79b9d">
Oct 26 17:02:09 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 17:02:09 user nova-compute[75113]:         </nova:port>
Oct 26 17:02:09 user nova-compute[75113]:       </nova:ports>
Oct 26 17:02:09 user nova-compute[75113]:     </nova:instance>
Oct 26 17:02:09 user nova-compute[75113]:   </metadata>
Oct 26 17:02:09 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:02:09 user nova-compute[75113]:     <system>
Oct 26 17:02:09 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:02:09 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:02:09 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:02:09 user nova-compute[75113]:       <entry name="serial">57a1b1df-ced1-4df2-8714-9aaa5f3c7e36</entry>
Oct 26 17:02:09 user nova-compute[75113]:       <entry name="uuid">57a1b1df-ced1-4df2-8714-9aaa5f3c7e36</entry>
Oct 26 17:02:09 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:02:09 user nova-compute[75113]:     </system>
Oct 26 17:02:09 user nova-compute[75113]:   </sysinfo>
Oct 26 17:02:09 user nova-compute[75113]:   <os>
Oct 26 17:02:09 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:02:09 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:02:09 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:02:09 user nova-compute[75113]:   </os>
Oct 26 17:02:09 user nova-compute[75113]:   <features>
Oct 26 17:02:09 user nova-compute[75113]:     <acpi/>
Oct 26 17:02:09 user nova-compute[75113]:     <apic/>
Oct 26 17:02:09 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:02:09 user nova-compute[75113]:   </features>
Oct 26 17:02:09 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:02:09 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:02:09 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:02:09 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:02:09 user nova-compute[75113]:   </clock>
Oct 26 17:02:09 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:02:09 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:02:09 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:02:09 user nova-compute[75113]:   </cpu>
Oct 26 17:02:09 user nova-compute[75113]:   <devices>
Oct 26 17:02:09 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:02:09 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:02:09 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk"/>
Oct 26 17:02:09 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:02:09 user nova-compute[75113]:     </disk>
Oct 26 17:02:09 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:02:09 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:02:09 user nova-compute[75113]:       <source dev="/dev/sdc"/>
Oct 26 17:02:09 user nova-compute[75113]:       <target dev="vdb" bus="virtio"/>
Oct 26 17:02:09 user nova-compute[75113]:       <serial>c0274fd0-61fa-4d16-a99a-c91310ce3597</serial>
Oct 26 17:02:09 user nova-compute[75113]:     </disk>
Oct 26 17:02:09 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:02:09 user nova-compute[75113]:       <mac address="fa:16:3e:e8:74:98"/>
Oct 26 17:02:09 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:09 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:02:09 user nova-compute[75113]:       <target dev="tapff980165-11"/>
Oct 26 17:02:09 user nova-compute[75113]:     </interface>
Oct 26 17:02:09 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:02:09 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/console.log" append="off"/>
Oct 26 17:02:09 user nova-compute[75113]:     </serial>
Oct 26 17:02:09 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:02:09 user nova-compute[75113]:     <video>
Oct 26 17:02:09 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:09 user nova-compute[75113]:     </video>
Oct 26 17:02:09 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:02:09 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:02:09 user nova-compute[75113]:     </rng>
Oct 26 17:02:09 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:02:09 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:02:09 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:02:09 user nova-compute[75113]:     </memballoon>
Oct 26 17:02:09 user nova-compute[75113]:   </devices>
Oct 26 17:02:09 user nova-compute[75113]: </domain>
Oct 26 17:02:09 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'trusted_certs' on Instance uuid 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG nova.objects.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Object Instance<57a1b1df-ced1-4df2-8714-9aaa5f3c7e36> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba29afc796ea486abef8eb2be84c2bb836f7ee94 --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Cannot resize image /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'migration_context' on Instance uuid 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG nova.objects.base [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Object Instance<57a1b1df-ced1-4df2-8714-9aaa5f3c7e36> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1982662822',display_name='tempest-TestMinimumBasicScenario-server-1982662822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1982662822',id=15,image_ref='0521c00f-82dc-45d4-8764-d12668ce2240',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9WGXEXrBv1HHrw/BahosIMiFehiyfTzuTP5JS60S6ifc+z3JAckDUJ8DH1IMfHJttIi9rYDvL4URf4GCDY6zxa1JU9fTzpckEU87gTgbFD+aLdpBaRRzDKuYiuSf0lnQ==',key_name='tempest-TestMinimumBasicScenario-1651364451',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:59:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='dd0d356ed9284735abb524c73c143e3b',ramdisk_id='',reservation_id='r-4nvn6z1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0521c00f-82dc-45d4-8764-d12668ce2240',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1757884343',owner_user_name='tempest-TestMinimumBasicScenario-1757884343-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:02:07Z,user_data=None,user_id='25d708e692104c63ac2e25531e82d734',uuid=57a1b1df-ced1-4df2-8714-9aaa5f3c7e36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converting VIF {"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG os_vif [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5157665-ea61-5248-aa37-1d2f58d0c4b1', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff980165-11, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff980165-11, col_values=(('qos', UUID('6475b017-fd81-4a64-b1ad-c97fd2006902')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff980165-11, col_values=(('external_ids', {'iface-id': 'ff980165-116a-431e-90a0-3a1d98b79b9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:74:98', 'vm-uuid': '57a1b1df-ced1-4df2-8714-9aaa5f3c7e36'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:10 user nova-compute[75113]: INFO os_vif [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11')
Oct 26 17:02:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:11 user nova-compute[75113]: DEBUG nova.compute.manager [req-055b89ec-e5d9-4070-926a-51652fb892c8 req-8cdf5e85-6c1d-427e-bd18-bff0cad9ddb0 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-055b89ec-e5d9-4070-926a-51652fb892c8 req-8cdf5e85-6c1d-427e-bd18-bff0cad9ddb0 service nova] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-055b89ec-e5d9-4070-926a-51652fb892c8 req-8cdf5e85-6c1d-427e-bd18-bff0cad9ddb0 service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-055b89ec-e5d9-4070-926a-51652fb892c8 req-8cdf5e85-6c1d-427e-bd18-bff0cad9ddb0 service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:11 user nova-compute[75113]: DEBUG nova.compute.manager [req-055b89ec-e5d9-4070-926a-51652fb892c8 req-8cdf5e85-6c1d-427e-bd18-bff0cad9ddb0 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] No waiting events found dispatching network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:11 user nova-compute[75113]: WARNING nova.compute.manager [req-055b89ec-e5d9-4070-926a-51652fb892c8 req-8cdf5e85-6c1d-427e-bd18-bff0cad9ddb0 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received unexpected event network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d for instance with vm_state active and task_state reboot_started_hard.
Oct 26 17:02:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.compute.manager [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:02:13 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Creating image(s)
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Ensure instance console log exists: /opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Start _get_guest_xml network_info=[{"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2f1ad302-72c7-4b02-83bd-fc6203adf815', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBLDWhkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9593d2bd-4eaf-4cc6-a3ab-8766f769d32e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a77e10d2-6a5d-4f5a-b37a-bfc05e92453c', 'serial': 'a77e10d2-6a5d-4f5a-b37a-bfc05e92453c'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:02:13 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:02:13 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBLDWhkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:02:13 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:02:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:02:13 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:02:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:02:13 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f69507d-a1b3-4184-85cc-a728f7e658cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:02:13 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[957d902d-57e1-436f-a8a9-3d096d536637]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c] added
Oct 26 17:02:13 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2067be0-44e3-4cc1-b078-6ad35d7b6ec6]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18d0786-2ea8-4af4-91ae-9a936c2e13e7]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBLDWhkS {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBLDWhkS" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c356d4-be15-4b29-8d34-b201213f33a3]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lBLDWhkS'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[84625c48-aee4-4d45-a97a-770c6d4b53ab]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc9984a-a4e4-4898-8ba4-bc3cce3ce733]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:13 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:13 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:13 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:13 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:02:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-a08b4efa-da55-415b-840f-ca071cf4f9ed req-b027a063-f60c-4507-b844-bfbcc8b43c16 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a08b4efa-da55-415b-840f-ca071cf4f9ed req-b027a063-f60c-4507-b844-bfbcc8b43c16 service nova] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a08b4efa-da55-415b-840f-ca071cf4f9ed req-b027a063-f60c-4507-b844-bfbcc8b43c16 service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a08b4efa-da55-415b-840f-ca071cf4f9ed req-b027a063-f60c-4507-b844-bfbcc8b43c16 service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-a08b4efa-da55-415b-840f-ca071cf4f9ed req-b027a063-f60c-4507-b844-bfbcc8b43c16 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] No waiting events found dispatching network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:14 user nova-compute[75113]: WARNING nova.compute.manager [req-a08b4efa-da55-415b-840f-ca071cf4f9ed req-b027a063-f60c-4507-b844-bfbcc8b43c16 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received unexpected event network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d for instance with vm_state active and task_state reboot_started_hard.
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccb34ee-a1e7-4580-8de0-0299066b4924]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c, portal: 172.16.0.220,3260]
Oct 26 17:02:14 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c, portal: 172.16.0.220,3260] successful.
Oct 26 17:02:14 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:02:14 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Instance rebooted successfully.
Oct 26 17:02:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2c090e-4a4f-42b6-b80e-b9ecb55b4fd5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea9c8c5-d2f3-4e17-b6a3-809dae9728f5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:14 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:14 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:14 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:14 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:14 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:14 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a03acd-8335-4358-ac30-234b1f42fef4]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBLDWhkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:02:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a1157062-4602-4b7a-879f-8355232202cd tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.377s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26537396537313237', 'path': '/dev/sdd'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537396537313237', 'path': '/dev/sdd'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1869311728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1869311728',id=18,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-a30od5ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:01:20Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=9593d2bd-4eaf-4cc6-a3ab-8766f769d32e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:73:98,bridge_name='br-int',has_traffic_filtering=True,id=2f8541b1-74e9-4dd3-ad25-bcf31b21f605,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8541b1-74') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG nova.objects.instance [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'pci_devices' on Instance uuid 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:02:15 user nova-compute[75113]:   <uuid>9593d2bd-4eaf-4cc6-a3ab-8766f769d32e</uuid>
Oct 26 17:02:15 user nova-compute[75113]:   <name>instance-00000012</name>
Oct 26 17:02:15 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:02:15 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:02:15 user nova-compute[75113]:   <metadata>
Oct 26 17:02:15 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:02:15 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:02:15 user nova-compute[75113]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1869311728</nova:name>
Oct 26 17:02:15 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:02:13</nova:creationTime>
Oct 26 17:02:15 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:02:15 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:02:15 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:02:15 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:02:15 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:02:15 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:02:15 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:02:15 user nova-compute[75113]:       <nova:owner>
Oct 26 17:02:15 user nova-compute[75113]:         <nova:user uuid="c431350f06fd4dbf8d74835f34626ee7">tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member</nova:user>
Oct 26 17:02:15 user nova-compute[75113]:         <nova:project uuid="9ae5d124cb054dfbbe04433a685903bc">tempest-ServerBootFromVolumeStableRescueTest-2080298495</nova:project>
Oct 26 17:02:15 user nova-compute[75113]:       </nova:owner>
Oct 26 17:02:15 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:02:15 user nova-compute[75113]:       <nova:ports>
Oct 26 17:02:15 user nova-compute[75113]:         <nova:port uuid="2f8541b1-74e9-4dd3-ad25-bcf31b21f605">
Oct 26 17:02:15 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 17:02:15 user nova-compute[75113]:         </nova:port>
Oct 26 17:02:15 user nova-compute[75113]:       </nova:ports>
Oct 26 17:02:15 user nova-compute[75113]:     </nova:instance>
Oct 26 17:02:15 user nova-compute[75113]:   </metadata>
Oct 26 17:02:15 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:02:15 user nova-compute[75113]:     <system>
Oct 26 17:02:15 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:02:15 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:02:15 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:02:15 user nova-compute[75113]:       <entry name="serial">9593d2bd-4eaf-4cc6-a3ab-8766f769d32e</entry>
Oct 26 17:02:15 user nova-compute[75113]:       <entry name="uuid">9593d2bd-4eaf-4cc6-a3ab-8766f769d32e</entry>
Oct 26 17:02:15 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:02:15 user nova-compute[75113]:     </system>
Oct 26 17:02:15 user nova-compute[75113]:   </sysinfo>
Oct 26 17:02:15 user nova-compute[75113]:   <os>
Oct 26 17:02:15 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:02:15 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:02:15 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:02:15 user nova-compute[75113]:   </os>
Oct 26 17:02:15 user nova-compute[75113]:   <features>
Oct 26 17:02:15 user nova-compute[75113]:     <acpi/>
Oct 26 17:02:15 user nova-compute[75113]:     <apic/>
Oct 26 17:02:15 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:02:15 user nova-compute[75113]:   </features>
Oct 26 17:02:15 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:02:15 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:02:15 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:02:15 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:02:15 user nova-compute[75113]:   </clock>
Oct 26 17:02:15 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:02:15 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:02:15 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:02:15 user nova-compute[75113]:   </cpu>
Oct 26 17:02:15 user nova-compute[75113]:   <devices>
Oct 26 17:02:15 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:02:15 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:02:15 user nova-compute[75113]:       <source dev="/dev/sdd"/>
Oct 26 17:02:15 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:02:15 user nova-compute[75113]:       <serial>a77e10d2-6a5d-4f5a-b37a-bfc05e92453c</serial>
Oct 26 17:02:15 user nova-compute[75113]:     </disk>
Oct 26 17:02:15 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:02:15 user nova-compute[75113]:       <mac address="fa:16:3e:96:73:98"/>
Oct 26 17:02:15 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:15 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:02:15 user nova-compute[75113]:       <target dev="tap2f8541b1-74"/>
Oct 26 17:02:15 user nova-compute[75113]:     </interface>
Oct 26 17:02:15 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:02:15 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e/console.log" append="off"/>
Oct 26 17:02:15 user nova-compute[75113]:     </serial>
Oct 26 17:02:15 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:02:15 user nova-compute[75113]:     <video>
Oct 26 17:02:15 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:15 user nova-compute[75113]:     </video>
Oct 26 17:02:15 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:02:15 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:02:15 user nova-compute[75113]:     </rng>
Oct 26 17:02:15 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:02:15 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:02:15 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:02:15 user nova-compute[75113]:     </memballoon>
Oct 26 17:02:15 user nova-compute[75113]:   </devices>
Oct 26 17:02:15 user nova-compute[75113]: </domain>
Oct 26 17:02:15 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1869311728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1869311728',id=18,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-a30od5ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:01:20Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=9593d2bd-4eaf-4cc6-a3ab-8766f769d32e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:73:98,bridge_name='br-int',has_traffic_filtering=True,id=2f8541b1-74e9-4dd3-ad25-bcf31b21f605,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8541b1-74') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG os_vif [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:73:98,bridge_name='br-int',has_traffic_filtering=True,id=2f8541b1-74e9-4dd3-ad25-bcf31b21f605,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8541b1-74') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d064081-6cc0-5035-a19e-c0a2f100119d', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f8541b1-74, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f8541b1-74, col_values=(('qos', UUID('93c5b66c-8c6d-4c71-b6b3-04a3040cbb14')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f8541b1-74, col_values=(('external_ids', {'iface-id': '2f8541b1-74e9-4dd3-ad25-bcf31b21f605', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:73:98', 'vm-uuid': '9593d2bd-4eaf-4cc6-a3ab-8766f769d32e'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:15 user nova-compute[75113]: INFO os_vif [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:73:98,bridge_name='br-int',has_traffic_filtering=True,id=2f8541b1-74e9-4dd3-ad25-bcf31b21f605,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8541b1-74')
Oct 26 17:02:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:02:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No VIF found with MAC fa:16:3e:96:73:98, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:02:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-9a4fd2a4-c208-4179-8f1e-ac2e1b41177b req-f9c1e42f-6dce-4531-8cac-50a2eeeabfea service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9a4fd2a4-c208-4179-8f1e-ac2e1b41177b req-f9c1e42f-6dce-4531-8cac-50a2eeeabfea service nova] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9a4fd2a4-c208-4179-8f1e-ac2e1b41177b req-f9c1e42f-6dce-4531-8cac-50a2eeeabfea service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9a4fd2a4-c208-4179-8f1e-ac2e1b41177b req-f9c1e42f-6dce-4531-8cac-50a2eeeabfea service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-9a4fd2a4-c208-4179-8f1e-ac2e1b41177b req-f9c1e42f-6dce-4531-8cac-50a2eeeabfea service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] No waiting events found dispatching network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:16 user nova-compute[75113]: WARNING nova.compute.manager [req-9a4fd2a4-c208-4179-8f1e-ac2e1b41177b req-f9c1e42f-6dce-4531-8cac-50a2eeeabfea service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received unexpected event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 for instance with vm_state building and task_state spawning.
Oct 26 17:02:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:02:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:02:18 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Instance spawned successfully.
Oct 26 17:02:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:02:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:18 user nova-compute[75113]: INFO nova.compute.manager [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Took 5.22 seconds to spawn the instance on the hypervisor.
Oct 26 17:02:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:02:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-4a69b42b-0d5a-4d3f-8b74-f44cc60eec90 req-3b1ec5ce-ea9e-4f41-b5ff-a3ca3d7ef3d7 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4a69b42b-0d5a-4d3f-8b74-f44cc60eec90 req-3b1ec5ce-ea9e-4f41-b5ff-a3ca3d7ef3d7 service nova] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4a69b42b-0d5a-4d3f-8b74-f44cc60eec90 req-3b1ec5ce-ea9e-4f41-b5ff-a3ca3d7ef3d7 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4a69b42b-0d5a-4d3f-8b74-f44cc60eec90 req-3b1ec5ce-ea9e-4f41-b5ff-a3ca3d7ef3d7 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-4a69b42b-0d5a-4d3f-8b74-f44cc60eec90 req-3b1ec5ce-ea9e-4f41-b5ff-a3ca3d7ef3d7 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] No waiting events found dispatching network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:19 user nova-compute[75113]: WARNING nova.compute.manager [req-4a69b42b-0d5a-4d3f-8b74-f44cc60eec90 req-3b1ec5ce-ea9e-4f41-b5ff-a3ca3d7ef3d7 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received unexpected event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 for instance with vm_state building and task_state spawning.
Oct 26 17:02:19 user nova-compute[75113]: INFO nova.compute.manager [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Took 60.43 seconds to build instance.
Oct 26 17:02:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-63a03ad9-6b1b-4c6c-83ad-25404bfcf491 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 60.539s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:35 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:02:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:35 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:02:35 user nova-compute[75113]: INFO nova.compute.claims [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Claim successful on node user
Oct 26 17:02:36 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG nova.network.neutron [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:02:36 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:02:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG nova.policy [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22531c3975dc4e29ab0e7be404592d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e6333344bf4cc6904e13f9fbe6005f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:02:36 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Creating image(s)
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "/opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "/opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.209s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.209s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk 1073741824" returned: 0 in 0.056s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.210s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:37 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:02:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:37 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Cannot resize image /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:02:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:02:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Ensure instance console log exists: /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:02:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:37 user nova-compute[75113]: DEBUG nova.network.neutron [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Successfully created port: 24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Successfully updated port: 24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "refresh_cache-6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquired lock "refresh_cache-6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-6b86bcca-026d-4e4a-b214-5b4e25a352ab req-be4d7b69-f677-49f7-b049-970dad34f6c5 service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Received event network-changed-24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-6b86bcca-026d-4e4a-b214-5b4e25a352ab req-be4d7b69-f677-49f7-b049-970dad34f6c5 service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Refreshing instance network info cache due to event network-changed-24851c98-7984-473a-9920-289d918c2949. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6b86bcca-026d-4e4a-b214-5b4e25a352ab req-be4d7b69-f677-49f7-b049-970dad34f6c5 service nova] Acquiring lock "refresh_cache-6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Updating instance_info_cache with network_info: [{"id": "24851c98-7984-473a-9920-289d918c2949", "address": "fa:16:3e:44:26:8c", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24851c98-79", "ovs_interfaceid": "24851c98-7984-473a-9920-289d918c2949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Releasing lock "refresh_cache-6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Instance network_info: |[{"id": "24851c98-7984-473a-9920-289d918c2949", "address": "fa:16:3e:44:26:8c", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24851c98-79", "ovs_interfaceid": "24851c98-7984-473a-9920-289d918c2949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6b86bcca-026d-4e4a-b214-5b4e25a352ab req-be4d7b69-f677-49f7-b049-970dad34f6c5 service nova] Acquired lock "refresh_cache-6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.network.neutron [req-6b86bcca-026d-4e4a-b214-5b4e25a352ab req-be4d7b69-f677-49f7-b049-970dad34f6c5 service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Refreshing network info cache for port 24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Start _get_guest_xml network_info=[{"id": "24851c98-7984-473a-9920-289d918c2949", "address": "fa:16:3e:44:26:8c", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24851c98-79", "ovs_interfaceid": "24851c98-7984-473a-9920-289d918c2949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:02:38 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:02:38 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:02:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-901967333',display_name='tempest-VolumesSnapshotTestJSON-instance-901967333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-901967333',id=20,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDg2MJdHPrUCv6JsHJXkZ5NVLkm16m5HhEMsmjKeWBTQ23UoBKHNGP/wzzaIm0GgujmwcXo7NjIs0Xran/jF6aAK3bXnpZ7O4zzhEEm/VkqhSCDC+qmDTdJ+/6uqu6ISg==',key_name='tempest-keypair-1089554665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49e6333344bf4cc6904e13f9fbe6005f',ramdisk_id='',reservation_id='r-ci4i1t45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1537589693',owner_user_name='tempest-VolumesSnapshotTestJSON-1537589693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22531c3975dc4e29ab0e7be404592d01',uuid=6ebdd6f0-640e-4c02-ac96-2d78fafb96e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24851c98-7984-473a-9920-289d918c2949", "address": "fa:16:3e:44:26:8c", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24851c98-79", "ovs_interfaceid": "24851c98-7984-473a-9920-289d918c2949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Converting VIF {"id": "24851c98-7984-473a-9920-289d918c2949", "address": "fa:16:3e:44:26:8c", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24851c98-79", "ovs_interfaceid": "24851c98-7984-473a-9920-289d918c2949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:26:8c,bridge_name='br-int',has_traffic_filtering=True,id=24851c98-7984-473a-9920-289d918c2949,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24851c98-79') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG nova.objects.instance [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:02:39 user nova-compute[75113]:   <uuid>6ebdd6f0-640e-4c02-ac96-2d78fafb96e1</uuid>
Oct 26 17:02:39 user nova-compute[75113]:   <name>instance-00000014</name>
Oct 26 17:02:39 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:02:39 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:02:39 user nova-compute[75113]:   <metadata>
Oct 26 17:02:39 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:02:39 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:02:39 user nova-compute[75113]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-901967333</nova:name>
Oct 26 17:02:39 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:02:38</nova:creationTime>
Oct 26 17:02:39 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:02:39 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:02:39 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:02:39 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:02:39 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:02:39 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:02:39 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:02:39 user nova-compute[75113]:       <nova:owner>
Oct 26 17:02:39 user nova-compute[75113]:         <nova:user uuid="22531c3975dc4e29ab0e7be404592d01">tempest-VolumesSnapshotTestJSON-1537589693-project-member</nova:user>
Oct 26 17:02:39 user nova-compute[75113]:         <nova:project uuid="49e6333344bf4cc6904e13f9fbe6005f">tempest-VolumesSnapshotTestJSON-1537589693</nova:project>
Oct 26 17:02:39 user nova-compute[75113]:       </nova:owner>
Oct 26 17:02:39 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:02:39 user nova-compute[75113]:       <nova:ports>
Oct 26 17:02:39 user nova-compute[75113]:         <nova:port uuid="24851c98-7984-473a-9920-289d918c2949">
Oct 26 17:02:39 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 17:02:39 user nova-compute[75113]:         </nova:port>
Oct 26 17:02:39 user nova-compute[75113]:       </nova:ports>
Oct 26 17:02:39 user nova-compute[75113]:     </nova:instance>
Oct 26 17:02:39 user nova-compute[75113]:   </metadata>
Oct 26 17:02:39 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:02:39 user nova-compute[75113]:     <system>
Oct 26 17:02:39 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:02:39 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:02:39 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:02:39 user nova-compute[75113]:       <entry name="serial">6ebdd6f0-640e-4c02-ac96-2d78fafb96e1</entry>
Oct 26 17:02:39 user nova-compute[75113]:       <entry name="uuid">6ebdd6f0-640e-4c02-ac96-2d78fafb96e1</entry>
Oct 26 17:02:39 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:02:39 user nova-compute[75113]:     </system>
Oct 26 17:02:39 user nova-compute[75113]:   </sysinfo>
Oct 26 17:02:39 user nova-compute[75113]:   <os>
Oct 26 17:02:39 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:02:39 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:02:39 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:02:39 user nova-compute[75113]:   </os>
Oct 26 17:02:39 user nova-compute[75113]:   <features>
Oct 26 17:02:39 user nova-compute[75113]:     <acpi/>
Oct 26 17:02:39 user nova-compute[75113]:     <apic/>
Oct 26 17:02:39 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:02:39 user nova-compute[75113]:   </features>
Oct 26 17:02:39 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:02:39 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:02:39 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:02:39 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:02:39 user nova-compute[75113]:   </clock>
Oct 26 17:02:39 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:02:39 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:02:39 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:02:39 user nova-compute[75113]:   </cpu>
Oct 26 17:02:39 user nova-compute[75113]:   <devices>
Oct 26 17:02:39 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:02:39 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:02:39 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk"/>
Oct 26 17:02:39 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:02:39 user nova-compute[75113]:     </disk>
Oct 26 17:02:39 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:02:39 user nova-compute[75113]:       <mac address="fa:16:3e:44:26:8c"/>
Oct 26 17:02:39 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:39 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:02:39 user nova-compute[75113]:       <target dev="tap24851c98-79"/>
Oct 26 17:02:39 user nova-compute[75113]:     </interface>
Oct 26 17:02:39 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:02:39 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/console.log" append="off"/>
Oct 26 17:02:39 user nova-compute[75113]:     </serial>
Oct 26 17:02:39 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:02:39 user nova-compute[75113]:     <video>
Oct 26 17:02:39 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:39 user nova-compute[75113]:     </video>
Oct 26 17:02:39 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:02:39 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:02:39 user nova-compute[75113]:     </rng>
Oct 26 17:02:39 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:02:39 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:02:39 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:02:39 user nova-compute[75113]:     </memballoon>
Oct 26 17:02:39 user nova-compute[75113]:   </devices>
Oct 26 17:02:39 user nova-compute[75113]: </domain>
Oct 26 17:02:39 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-901967333',display_name='tempest-VolumesSnapshotTestJSON-instance-901967333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-901967333',id=20,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDg2MJdHPrUCv6JsHJXkZ5NVLkm16m5HhEMsmjKeWBTQ23UoBKHNGP/wzzaIm0GgujmwcXo7NjIs0Xran/jF6aAK3bXnpZ7O4zzhEEm/VkqhSCDC+qmDTdJ+/6uqu6ISg==',key_name='tempest-keypair-1089554665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49e6333344bf4cc6904e13f9fbe6005f',ramdisk_id='',reservation_id='r-ci4i1t45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1537589693',owner_user_name='tempest-VolumesSnapshotTestJSON-1537589693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22531c3975dc4e29ab0e7be404592d01',uuid=6ebdd6f0-640e-4c02-ac96-2d78fafb96e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24851c98-7984-473a-9920-289d918c2949", "address": "fa:16:3e:44:26:8c", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24851c98-79", "ovs_interfaceid": "24851c98-7984-473a-9920-289d918c2949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Converting VIF {"id": "24851c98-7984-473a-9920-289d918c2949", "address": "fa:16:3e:44:26:8c", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24851c98-79", "ovs_interfaceid": "24851c98-7984-473a-9920-289d918c2949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:26:8c,bridge_name='br-int',has_traffic_filtering=True,id=24851c98-7984-473a-9920-289d918c2949,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24851c98-79') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG os_vif [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:26:8c,bridge_name='br-int',has_traffic_filtering=True,id=24851c98-7984-473a-9920-289d918c2949,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24851c98-79') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26de5c47-fe28-5370-a697-574653337627', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24851c98-79, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24851c98-79, col_values=(('qos', UUID('b4042f2b-fca3-4c53-b4ab-69f6bc815e64')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24851c98-79, col_values=(('external_ids', {'iface-id': '24851c98-7984-473a-9920-289d918c2949', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:26:8c', 'vm-uuid': '6ebdd6f0-640e-4c02-ac96-2d78fafb96e1'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:39 user nova-compute[75113]: INFO os_vif [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:26:8c,bridge_name='br-int',has_traffic_filtering=True,id=24851c98-7984-473a-9920-289d918c2949,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24851c98-79')
Oct 26 17:02:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] No VIF found with MAC fa:16:3e:44:26:8c, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG nova.network.neutron [req-6b86bcca-026d-4e4a-b214-5b4e25a352ab req-be4d7b69-f677-49f7-b049-970dad34f6c5 service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Updated VIF entry in instance network info cache for port 24851c98-7984-473a-9920-289d918c2949. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG nova.network.neutron [req-6b86bcca-026d-4e4a-b214-5b4e25a352ab req-be4d7b69-f677-49f7-b049-970dad34f6c5 service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Updating instance_info_cache with network_info: [{"id": "24851c98-7984-473a-9920-289d918c2949", "address": "fa:16:3e:44:26:8c", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24851c98-79", "ovs_interfaceid": "24851c98-7984-473a-9920-289d918c2949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:02:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6b86bcca-026d-4e4a-b214-5b4e25a352ab req-be4d7b69-f677-49f7-b049-970dad34f6c5 service nova] Releasing lock "refresh_cache-6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:02:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:40 user nova-compute[75113]: DEBUG nova.compute.manager [req-43e7b16b-ccd7-4152-8923-25ae6ca3c703 req-0041db5e-063e-4691-a670-0cef9bef0193 service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Received event network-vif-plugged-24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43e7b16b-ccd7-4152-8923-25ae6ca3c703 req-0041db5e-063e-4691-a670-0cef9bef0193 service nova] Acquiring lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43e7b16b-ccd7-4152-8923-25ae6ca3c703 req-0041db5e-063e-4691-a670-0cef9bef0193 service nova] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43e7b16b-ccd7-4152-8923-25ae6ca3c703 req-0041db5e-063e-4691-a670-0cef9bef0193 service nova] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:40 user nova-compute[75113]: DEBUG nova.compute.manager [req-43e7b16b-ccd7-4152-8923-25ae6ca3c703 req-0041db5e-063e-4691-a670-0cef9bef0193 service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] No waiting events found dispatching network-vif-plugged-24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:40 user nova-compute[75113]: WARNING nova.compute.manager [req-43e7b16b-ccd7-4152-8923-25ae6ca3c703 req-0041db5e-063e-4691-a670-0cef9bef0193 service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Received unexpected event network-vif-plugged-24851c98-7984-473a-9920-289d918c2949 for instance with vm_state building and task_state spawning.
Oct 26 17:02:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Acquiring lock "dd051355-efa5-40a9-a1fc-89ddb87c456e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Acquiring lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:41 user nova-compute[75113]: INFO nova.compute.manager [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Terminating instance
Oct 26 17:02:41 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:02:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG nova.compute.manager [req-378a2ce9-30e7-483b-9dd7-0a7464bf3a25 req-8ef35d69-6384-43da-8769-9f5ccbdfaac8 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Received event network-vif-unplugged-c56a7bab-9148-426a-8c9f-960a14205cb2 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-378a2ce9-30e7-483b-9dd7-0a7464bf3a25 req-8ef35d69-6384-43da-8769-9f5ccbdfaac8 service nova] Acquiring lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-378a2ce9-30e7-483b-9dd7-0a7464bf3a25 req-8ef35d69-6384-43da-8769-9f5ccbdfaac8 service nova] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-378a2ce9-30e7-483b-9dd7-0a7464bf3a25 req-8ef35d69-6384-43da-8769-9f5ccbdfaac8 service nova] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG nova.compute.manager [req-378a2ce9-30e7-483b-9dd7-0a7464bf3a25 req-8ef35d69-6384-43da-8769-9f5ccbdfaac8 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] No waiting events found dispatching network-vif-unplugged-c56a7bab-9148-426a-8c9f-960a14205cb2 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG nova.compute.manager [req-378a2ce9-30e7-483b-9dd7-0a7464bf3a25 req-8ef35d69-6384-43da-8769-9f5ccbdfaac8 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Received event network-vif-unplugged-c56a7bab-9148-426a-8c9f-960a14205cb2 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:02:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Instance destroyed successfully.
Oct 26 17:02:42 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lazy-loading 'resources' on Instance uuid dd051355-efa5-40a9-a1fc-89ddb87c456e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:00:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1037029726',display_name='tempest-VolumesNegativeTest-instance-1037029726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1037029726',id=17,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:01:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2907f465cdf34e34b5578433ac098eb4',ramdisk_id='',reservation_id='r-1us01xfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1058379337',owner_user_name='tempest-VolumesNegativeTest-1058379337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:01:02Z,user_data=None,user_id='40ac662c40c44c51b75907edc5824055',uuid=dd051355-efa5-40a9-a1fc-89ddb87c456e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c56a7bab-9148-426a-8c9f-960a14205cb2", "address": "fa:16:3e:c0:f1:53", "network": {"id": "b960d722-049c-4c9d-a19b-482e751ddb0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "314c50648df9400297d4a6a4d8aab9e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56a7bab-91", "ovs_interfaceid": "c56a7bab-9148-426a-8c9f-960a14205cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Converting VIF {"id": "c56a7bab-9148-426a-8c9f-960a14205cb2", "address": "fa:16:3e:c0:f1:53", "network": {"id": "b960d722-049c-4c9d-a19b-482e751ddb0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "314c50648df9400297d4a6a4d8aab9e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56a7bab-91", "ovs_interfaceid": "c56a7bab-9148-426a-8c9f-960a14205cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c56a7bab-9148-426a-8c9f-960a14205cb2,network=Network(b960d722-049c-4c9d-a19b-482e751ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56a7bab-91') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG os_vif [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c56a7bab-9148-426a-8c9f-960a14205cb2,network=Network(b960d722-049c-4c9d-a19b-482e751ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56a7bab-91') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc56a7bab-91, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b12f31e-150b-4a55-a5d7-e4a1227746ce) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:42 user nova-compute[75113]: INFO os_vif [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c56a7bab-9148-426a-8c9f-960a14205cb2,network=Network(b960d722-049c-4c9d-a19b-482e751ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56a7bab-91')
Oct 26 17:02:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Deleting instance files /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e_del
Oct 26 17:02:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Deletion of /opt/stack/data/nova/instances/dd051355-efa5-40a9-a1fc-89ddb87c456e_del complete
Oct 26 17:02:42 user nova-compute[75113]: INFO nova.compute.manager [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 26 17:02:42 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG nova.compute.manager [req-ef05aaf0-6d89-46e0-8464-ab3c3526ce53 req-f2b806f5-2e4b-4c38-bda8-df5289375fc8 service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Received event network-vif-plugged-24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ef05aaf0-6d89-46e0-8464-ab3c3526ce53 req-f2b806f5-2e4b-4c38-bda8-df5289375fc8 service nova] Acquiring lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ef05aaf0-6d89-46e0-8464-ab3c3526ce53 req-f2b806f5-2e4b-4c38-bda8-df5289375fc8 service nova] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ef05aaf0-6d89-46e0-8464-ab3c3526ce53 req-f2b806f5-2e4b-4c38-bda8-df5289375fc8 service nova] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:42 user nova-compute[75113]: DEBUG nova.compute.manager [req-ef05aaf0-6d89-46e0-8464-ab3c3526ce53 req-f2b806f5-2e4b-4c38-bda8-df5289375fc8 service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] No waiting events found dispatching network-vif-plugged-24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:42 user nova-compute[75113]: WARNING nova.compute.manager [req-ef05aaf0-6d89-46e0-8464-ab3c3526ce53 req-f2b806f5-2e4b-4c38-bda8-df5289375fc8 service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Received unexpected event network-vif-plugged-24851c98-7984-473a-9920-289d918c2949 for instance with vm_state building and task_state spawning.
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:02:43 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Instance spawned successfully.
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:43 user nova-compute[75113]: INFO nova.compute.manager [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Took 6.70 seconds to spawn the instance on the hypervisor.
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:02:43 user nova-compute[75113]: INFO nova.compute.manager [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Took 7.64 seconds to build instance.
Oct 26 17:02:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9217cea-1acc-483b-896e-2cb63dd95b3b tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.771s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:02:43 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Took 1.18 seconds to deallocate network for instance.
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.compute.manager [req-04301c5b-ae24-42ec-9cde-c374b827fb76 req-2b2cc63b-4ef4-4f29-aacf-0086c7a1f7bf service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Received event network-vif-deleted-c56a7bab-9148-426a-8c9f-960a14205cb2 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:43 user nova-compute[75113]: INFO nova.compute.manager [req-04301c5b-ae24-42ec-9cde-c374b827fb76 req-2b2cc63b-4ef4-4f29-aacf-0086c7a1f7bf service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Neutron deleted interface c56a7bab-9148-426a-8c9f-960a14205cb2; detaching it from the instance and deleting it from the info cache
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.network.neutron [req-04301c5b-ae24-42ec-9cde-c374b827fb76 req-2b2cc63b-4ef4-4f29-aacf-0086c7a1f7bf service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:02:43 user nova-compute[75113]: DEBUG nova.compute.manager [req-04301c5b-ae24-42ec-9cde-c374b827fb76 req-2b2cc63b-4ef4-4f29-aacf-0086c7a1f7bf service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Detach interface failed, port_id=c56a7bab-9148-426a-8c9f-960a14205cb2, reason: Instance dd051355-efa5-40a9-a1fc-89ddb87c456e could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:02:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:44 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:02:44 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:02:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:44 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Deleted allocations for instance dd051355-efa5-40a9-a1fc-89ddb87c456e
Oct 26 17:02:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-7875214a-d96c-4e5a-8818-dd39e9efd64c req-65cfb1b9-ab07-45f5-be8e-89f90289f9d3 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Received event network-vif-plugged-c56a7bab-9148-426a-8c9f-960a14205cb2 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7875214a-d96c-4e5a-8818-dd39e9efd64c req-65cfb1b9-ab07-45f5-be8e-89f90289f9d3 service nova] Acquiring lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7875214a-d96c-4e5a-8818-dd39e9efd64c req-65cfb1b9-ab07-45f5-be8e-89f90289f9d3 service nova] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7875214a-d96c-4e5a-8818-dd39e9efd64c req-65cfb1b9-ab07-45f5-be8e-89f90289f9d3 service nova] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-7875214a-d96c-4e5a-8818-dd39e9efd64c req-65cfb1b9-ab07-45f5-be8e-89f90289f9d3 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] No waiting events found dispatching network-vif-plugged-c56a7bab-9148-426a-8c9f-960a14205cb2 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:44 user nova-compute[75113]: WARNING nova.compute.manager [req-7875214a-d96c-4e5a-8818-dd39e9efd64c req-65cfb1b9-ab07-45f5-be8e-89f90289f9d3 service nova] [instance: dd051355-efa5-40a9-a1fc-89ddb87c456e] Received unexpected event network-vif-plugged-c56a7bab-9148-426a-8c9f-960a14205cb2 for instance with vm_state deleted and task_state None.
Oct 26 17:02:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4513eae3-9e28-4b6f-afc0-d532061594cf tempest-VolumesNegativeTest-1058379337 tempest-VolumesNegativeTest-1058379337-project-member] Lock "dd051355-efa5-40a9-a1fc-89ddb87c456e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.551s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:02:45 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Creating image(s)
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Ensure instance console log exists: /opt/stack/data/nova/instances/76039e5a-db02-48b4-81eb-a7383d1374b1/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Start _get_guest_xml network_info=[{"id": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "address": "fa:16:3e:62:67:cf", "network": {"id": "e7216aad-39cb-4142-8c1f-dce1020dcc12", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-111571776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cf0eba-47", "ovs_interfaceid": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "address": "fa:16:3e:de:4c:5a", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa8c9bd5-e4", "ovs_interfaceid": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "address": "fa:16:3e:6f:10:8d", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eaa7ff-68", "ovs_interfaceid": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "address": "fa:16:3e:54:87:08", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1957f9-f8", "ovs_interfaceid": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "address": "fa:16:3e:03:49:9c", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfb2aba-69", "ovs_interfaceid": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "037fd8ce-526b-4c04-bd17-4402781e28ed", "address": "fa:16:3e:d2:0b:83", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037fd8ce-52", "ovs_interfaceid": "037fd8ce-526b-4c04-bd17-4402781e28ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c34234e-daf0-44a0-8c1c-94721e415e19", "address": "fa:16:3e:e2:4b:a1", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c34234e-da", "ovs_interfaceid": "5c34234e-daf0-44a0-8c1c-94721e415e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'dead6c75-239e-4add-8e52-495b6e1ee22a', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCsygKjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '76039e5a-db02-48b4-81eb-a7383d1374b1', 'attached_at': '', 'detached_at': '', 'volume_id': '28c72787-3acd-414f-9c4d-af5a4be57620', 'serial': '28c72787-3acd-414f-9c4d-af5a4be57620'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None}, {'attachment_id': 'b22ec249-f9cd-4e51-b4f7-912d33dd4892', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StXnhUfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '76039e5a-db02-48b4-81eb-a7383d1374b1', 'attached_at': '', 'detached_at': '', 'volume_id': '302b2aca-51b0-49c5-a4f9-7dbc9530e05b', 'serial': '302b2aca-51b0-49c5-a4f9-7dbc9530e05b'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 1, 'mount_device': '/dev/vdb', 'volume_type': None}, {'attachment_id': 'd7b1b109-04ba-47e5-b079-f9e744a07aeb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRCAOWXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '76039e5a-db02-48b4-81eb-a7383d1374b1', 'attached_at': '', 'detached_at': '', 'volume_id': 'b438bcd2-60a0-476e-9af3-a729a27dc3f4', 'serial': 'b438bcd2-60a0-476e-9af3-a729a27dc3f4'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 2, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:02:45 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:02:45 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCsygKjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:02:45 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:02:45 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:02:45 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30fe768-9c35-446e-b865-8f13ed82b980]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:02:45 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d352948b-f5c0-4639-aeda-2813863a19e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620] added
Oct 26 17:02:45 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[965cf3b2-8b1d-4ba5-be07-11e9355cc908]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9679993-123b-415d-91cd-9607cc23da24]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCsygKjH {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCsygKjH" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cc03a4-e085-45dd-8082-7135ed6e9dab]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OCsygKjH'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2706b8-c5f0-4dfb-920a-2d766147c5b9]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce33ac4-e75d-4f6f-be8a-6d6feffac813]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:45 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:45 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:45 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:45 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:45 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:45 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7f5cee-dc2b-4248-b8cf-167d827e117d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620, portal: 172.16.0.220,3260]
Oct 26 17:02:45 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620, portal: 172.16.0.220,3260] successful.
Oct 26 17:02:45 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a86ad70-ed30-484c-b985-9de29ff4a515]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6394fa1e-0ea1-4ad6-b239-89bb0e6d9bcb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:45 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:45 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:45 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:02:45 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:45 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:45 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:45 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:02:45 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a630d76-b44d-4360-ba83-e38fcc3d4602]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:45 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCsygKjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26639363661313938', 'path': '/dev/sde'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639363661313938', 'path': '/dev/sde'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StXnhUfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:02:46 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:02:46 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:02:46 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5321379e-addd-4e78-9771-1ca517ad64e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:02:46 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[709dce0b-3334-4946-9a6a-62efd9ffd2cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b] added
Oct 26 17:02:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb8bf58-9366-49d4-863b-a82333d8d37e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7372b2-faeb-407d-8d05-487073165be8]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StXnhUfI {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StXnhUfI" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a94bfc4-18bc-48a0-9b2f-31f1bb9634db]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'StXnhUfI'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31d30b2-f64e-431f-a500-d9bbc881b6d6]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[854a98e1-3072-4f6a-a3fa-9df868e5473f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:02:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:02:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f4a4d3-724b-4697-ae39-007d579cf618]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b, portal: 172.16.0.220,3260]
Oct 26 17:02:46 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b, portal: 172.16.0.220,3260] successful.
Oct 26 17:02:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dad49a-b87e-4375-9fc6-005441484080]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73da94f-740b-4486-aecc-34200d27893f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:02:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:02:46 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:02:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c015af-5ba7-4063-a6a3-739def0daf21]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:02:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StXnhUfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:02:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:02:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23632383035643133', 'path': '/dev/sdf'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:02:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632383035643133', 'path': '/dev/sdf'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRCAOWXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:02:48 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:02:48 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:02:48 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbea9b11-a181-47cf-beef-b1be216f9ed4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:02:48 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6948f31-e22c-4967-a113-42db43424bff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4] added
Oct 26 17:02:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d83b4e3-e2a8-4583-bf25-478ae10ff6a0]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffdcc2c-1217-419d-902f-5d3714f00e18]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LRCAOWXP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LRCAOWXP" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2198624-5d40-41a8-ab66-65e5a06ca6f1]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LRCAOWXP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0744c2-998e-4c77-902b-a932f43261fe]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d5bbd1-d60e-4446-88a6-f58ea5781ac2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:02:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:02:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a35ca6-9261-4c84-9815-ca9401caca51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4, portal: 172.16.0.220,3260]
Oct 26 17:02:48 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4, portal: 172.16.0.220,3260] successful.
Oct 26 17:02:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6689aee7-77ec-42ea-a39f-ec6a1f38e455]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[33235666-87ba-4ec1-8d30-6bcfcb0c038f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:02:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:02:48 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:02:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[493c166f-ef20-4d81-81d6-0c8cbb4dd414]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:02:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRCAOWXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23264386139383662', 'path': '/dev/sdg'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264386139383662', 'path': '/dev/sdg'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "address": "fa:16:3e:62:67:cf", "network": {"id": "e7216aad-39cb-4142-8c1f-dce1020dcc12", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-111571776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cf0eba-47", "ovs_interfaceid": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "address": "fa:16:3e:62:67:cf", "network": {"id": "e7216aad-39cb-4142-8c1f-dce1020dcc12", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-111571776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cf0eba-47", "ovs_interfaceid": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=95cf0eba-473a-4dfd-a3a7-1d8fec6399ce,network=Network(e7216aad-39cb-4142-8c1f-dce1020dcc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cf0eba-47') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "address": "fa:16:3e:de:4c:5a", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa8c9bd5-e4", "ovs_interfaceid": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "address": "fa:16:3e:de:4c:5a", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa8c9bd5-e4", "ovs_interfaceid": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=aa8c9bd5-e40f-45d7-addc-a0f5773791c5,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa8c9bd5-e4') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "address": "fa:16:3e:6f:10:8d", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eaa7ff-68", "ovs_interfaceid": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "address": "fa:16:3e:6f:10:8d", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eaa7ff-68", "ovs_interfaceid": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:10:8d,bridge_name='br-int',has_traffic_filtering=True,id=71eaa7ff-686b-4e1b-94b5-0b572d28e68b,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71eaa7ff-68') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "address": "fa:16:3e:54:87:08", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1957f9-f8", "ovs_interfaceid": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "address": "fa:16:3e:54:87:08", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1957f9-f8", "ovs_interfaceid": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:87:08,bridge_name='br-int',has_traffic_filtering=True,id=fe1957f9-f87b-4d7b-98f9-425e92dbd68d,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1957f9-f8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "address": "fa:16:3e:03:49:9c", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfb2aba-69", "ovs_interfaceid": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "address": "fa:16:3e:03:49:9c", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfb2aba-69", "ovs_interfaceid": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=1bfb2aba-69ec-49d5-8875-6a2ec2049ac2,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfb2aba-69') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "037fd8ce-526b-4c04-bd17-4402781e28ed", "address": "fa:16:3e:d2:0b:83", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037fd8ce-52", "ovs_interfaceid": "037fd8ce-526b-4c04-bd17-4402781e28ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "037fd8ce-526b-4c04-bd17-4402781e28ed", "address": "fa:16:3e:d2:0b:83", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037fd8ce-52", "ovs_interfaceid": "037fd8ce-526b-4c04-bd17-4402781e28ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:83,bridge_name='br-int',has_traffic_filtering=True,id=037fd8ce-526b-4c04-bd17-4402781e28ed,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037fd8ce-52') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c34234e-daf0-44a0-8c1c-94721e415e19", "address": "fa:16:3e:e2:4b:a1", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c34234e-da", "ovs_interfaceid": "5c34234e-daf0-44a0-8c1c-94721e415e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "5c34234e-daf0-44a0-8c1c-94721e415e19", "address": "fa:16:3e:e2:4b:a1", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c34234e-da", "ovs_interfaceid": "5c34234e-daf0-44a0-8c1c-94721e415e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4b:a1,bridge_name='br-int',has_traffic_filtering=True,id=5c34234e-daf0-44a0-8c1c-94721e415e19,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c34234e-da') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.objects.instance [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lazy-loading 'pci_devices' on Instance uuid 76039e5a-db02-48b4-81eb-a7383d1374b1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:02:49 user nova-compute[75113]:   <uuid>76039e5a-db02-48b4-81eb-a7383d1374b1</uuid>
Oct 26 17:02:49 user nova-compute[75113]:   <name>instance-00000010</name>
Oct 26 17:02:49 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:02:49 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:02:49 user nova-compute[75113]:   <metadata>
Oct 26 17:02:49 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:02:49 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:02:49 user nova-compute[75113]:       <nova:name>tempest-device-tagging-server-1001851615</nova:name>
Oct 26 17:02:49 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:02:45</nova:creationTime>
Oct 26 17:02:49 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:02:49 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:02:49 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:02:49 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:02:49 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:02:49 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:02:49 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:02:49 user nova-compute[75113]:       <nova:owner>
Oct 26 17:02:49 user nova-compute[75113]:         <nova:user uuid="d4715aee69ed453eb02e312435fb6621">tempest-TaggedBootDevicesTest-1221982702-project-member</nova:user>
Oct 26 17:02:49 user nova-compute[75113]:         <nova:project uuid="8f7ccf18d4d8467f961b5ec1e8df785b">tempest-TaggedBootDevicesTest-1221982702</nova:project>
Oct 26 17:02:49 user nova-compute[75113]:       </nova:owner>
Oct 26 17:02:49 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:02:49 user nova-compute[75113]:       <nova:ports>
Oct 26 17:02:49 user nova-compute[75113]:         <nova:port uuid="95cf0eba-473a-4dfd-a3a7-1d8fec6399ce">
Oct 26 17:02:49 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 17:02:49 user nova-compute[75113]:         </nova:port>
Oct 26 17:02:49 user nova-compute[75113]:         <nova:port uuid="aa8c9bd5-e40f-45d7-addc-a0f5773791c5">
Oct 26 17:02:49 user nova-compute[75113]:           <nova:ip type="fixed" address="10.1.1.106" ipVersion="4"/>
Oct 26 17:02:49 user nova-compute[75113]:         </nova:port>
Oct 26 17:02:49 user nova-compute[75113]:         <nova:port uuid="71eaa7ff-686b-4e1b-94b5-0b572d28e68b">
Oct 26 17:02:49 user nova-compute[75113]:           <nova:ip type="fixed" address="10.1.1.204" ipVersion="4"/>
Oct 26 17:02:49 user nova-compute[75113]:         </nova:port>
Oct 26 17:02:49 user nova-compute[75113]:         <nova:port uuid="fe1957f9-f87b-4d7b-98f9-425e92dbd68d">
Oct 26 17:02:49 user nova-compute[75113]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Oct 26 17:02:49 user nova-compute[75113]:         </nova:port>
Oct 26 17:02:49 user nova-compute[75113]:         <nova:port uuid="1bfb2aba-69ec-49d5-8875-6a2ec2049ac2">
Oct 26 17:02:49 user nova-compute[75113]:           <nova:ip type="fixed" address="10.1.1.23" ipVersion="4"/>
Oct 26 17:02:49 user nova-compute[75113]:         </nova:port>
Oct 26 17:02:49 user nova-compute[75113]:         <nova:port uuid="037fd8ce-526b-4c04-bd17-4402781e28ed">
Oct 26 17:02:49 user nova-compute[75113]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 26 17:02:49 user nova-compute[75113]:         </nova:port>
Oct 26 17:02:49 user nova-compute[75113]:         <nova:port uuid="5c34234e-daf0-44a0-8c1c-94721e415e19">
Oct 26 17:02:49 user nova-compute[75113]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 26 17:02:49 user nova-compute[75113]:         </nova:port>
Oct 26 17:02:49 user nova-compute[75113]:       </nova:ports>
Oct 26 17:02:49 user nova-compute[75113]:     </nova:instance>
Oct 26 17:02:49 user nova-compute[75113]:   </metadata>
Oct 26 17:02:49 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:02:49 user nova-compute[75113]:     <system>
Oct 26 17:02:49 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:02:49 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:02:49 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:02:49 user nova-compute[75113]:       <entry name="serial">76039e5a-db02-48b4-81eb-a7383d1374b1</entry>
Oct 26 17:02:49 user nova-compute[75113]:       <entry name="uuid">76039e5a-db02-48b4-81eb-a7383d1374b1</entry>
Oct 26 17:02:49 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:02:49 user nova-compute[75113]:     </system>
Oct 26 17:02:49 user nova-compute[75113]:   </sysinfo>
Oct 26 17:02:49 user nova-compute[75113]:   <os>
Oct 26 17:02:49 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:02:49 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:02:49 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:02:49 user nova-compute[75113]:   </os>
Oct 26 17:02:49 user nova-compute[75113]:   <features>
Oct 26 17:02:49 user nova-compute[75113]:     <acpi/>
Oct 26 17:02:49 user nova-compute[75113]:     <apic/>
Oct 26 17:02:49 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:02:49 user nova-compute[75113]:   </features>
Oct 26 17:02:49 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:02:49 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:02:49 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:02:49 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:02:49 user nova-compute[75113]:   </clock>
Oct 26 17:02:49 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:02:49 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:02:49 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:02:49 user nova-compute[75113]:   </cpu>
Oct 26 17:02:49 user nova-compute[75113]:   <devices>
Oct 26 17:02:49 user nova-compute[75113]:     <disk type="file" device="cdrom">
Oct 26 17:02:49 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 17:02:49 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/76039e5a-db02-48b4-81eb-a7383d1374b1/disk.config"/>
Oct 26 17:02:49 user nova-compute[75113]:       <target dev="hda" bus="ide"/>
Oct 26 17:02:49 user nova-compute[75113]:     </disk>
Oct 26 17:02:49 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:02:49 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:02:49 user nova-compute[75113]:       <source dev="/dev/sde"/>
Oct 26 17:02:49 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:02:49 user nova-compute[75113]:       <serial>28c72787-3acd-414f-9c4d-af5a4be57620</serial>
Oct 26 17:02:49 user nova-compute[75113]:     </disk>
Oct 26 17:02:49 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:02:49 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:02:49 user nova-compute[75113]:       <source dev="/dev/sdf"/>
Oct 26 17:02:49 user nova-compute[75113]:       <target dev="vdb" bus="virtio"/>
Oct 26 17:02:49 user nova-compute[75113]:       <serial>302b2aca-51b0-49c5-a4f9-7dbc9530e05b</serial>
Oct 26 17:02:49 user nova-compute[75113]:     </disk>
Oct 26 17:02:49 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:02:49 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:02:49 user nova-compute[75113]:       <source dev="/dev/sdg"/>
Oct 26 17:02:49 user nova-compute[75113]:       <target dev="vdc" bus="virtio"/>
Oct 26 17:02:49 user nova-compute[75113]:       <serial>b438bcd2-60a0-476e-9af3-a729a27dc3f4</serial>
Oct 26 17:02:49 user nova-compute[75113]:     </disk>
Oct 26 17:02:49 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:02:49 user nova-compute[75113]:       <mac address="fa:16:3e:62:67:cf"/>
Oct 26 17:02:49 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:49 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:02:49 user nova-compute[75113]:       <target dev="tap95cf0eba-47"/>
Oct 26 17:02:49 user nova-compute[75113]:     </interface>
Oct 26 17:02:49 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:02:49 user nova-compute[75113]:       <mac address="fa:16:3e:de:4c:5a"/>
Oct 26 17:02:49 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:49 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:02:49 user nova-compute[75113]:       <target dev="tapaa8c9bd5-e4"/>
Oct 26 17:02:49 user nova-compute[75113]:     </interface>
Oct 26 17:02:49 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:02:49 user nova-compute[75113]:       <mac address="fa:16:3e:6f:10:8d"/>
Oct 26 17:02:49 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:49 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:02:49 user nova-compute[75113]:       <target dev="tap71eaa7ff-68"/>
Oct 26 17:02:49 user nova-compute[75113]:     </interface>
Oct 26 17:02:49 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:02:49 user nova-compute[75113]:       <mac address="fa:16:3e:54:87:08"/>
Oct 26 17:02:49 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:49 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:02:49 user nova-compute[75113]:       <target dev="tapfe1957f9-f8"/>
Oct 26 17:02:49 user nova-compute[75113]:     </interface>
Oct 26 17:02:49 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:02:49 user nova-compute[75113]:       <mac address="fa:16:3e:03:49:9c"/>
Oct 26 17:02:49 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:49 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:02:49 user nova-compute[75113]:       <target dev="tap1bfb2aba-69"/>
Oct 26 17:02:49 user nova-compute[75113]:     </interface>
Oct 26 17:02:49 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:02:49 user nova-compute[75113]:       <mac address="fa:16:3e:d2:0b:83"/>
Oct 26 17:02:49 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:49 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:02:49 user nova-compute[75113]:       <target dev="tap037fd8ce-52"/>
Oct 26 17:02:49 user nova-compute[75113]:     </interface>
Oct 26 17:02:49 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:02:49 user nova-compute[75113]:       <mac address="fa:16:3e:e2:4b:a1"/>
Oct 26 17:02:49 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:49 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:02:49 user nova-compute[75113]:       <target dev="tap5c34234e-da"/>
Oct 26 17:02:49 user nova-compute[75113]:     </interface>
Oct 26 17:02:49 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:02:49 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/76039e5a-db02-48b4-81eb-a7383d1374b1/console.log" append="off"/>
Oct 26 17:02:49 user nova-compute[75113]:     </serial>
Oct 26 17:02:49 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:02:49 user nova-compute[75113]:     <video>
Oct 26 17:02:49 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:02:49 user nova-compute[75113]:     </video>
Oct 26 17:02:49 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:02:49 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:02:49 user nova-compute[75113]:     </rng>
Oct 26 17:02:49 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:02:49 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:02:49 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:02:49 user nova-compute[75113]:     </memballoon>
Oct 26 17:02:49 user nova-compute[75113]:   </devices>
Oct 26 17:02:49 user nova-compute[75113]: </domain>
Oct 26 17:02:49 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "address": "fa:16:3e:62:67:cf", "network": {"id": "e7216aad-39cb-4142-8c1f-dce1020dcc12", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-111571776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cf0eba-47", "ovs_interfaceid": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "address": "fa:16:3e:62:67:cf", "network": {"id": "e7216aad-39cb-4142-8c1f-dce1020dcc12", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-111571776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cf0eba-47", "ovs_interfaceid": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=95cf0eba-473a-4dfd-a3a7-1d8fec6399ce,network=Network(e7216aad-39cb-4142-8c1f-dce1020dcc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cf0eba-47') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=95cf0eba-473a-4dfd-a3a7-1d8fec6399ce,network=Network(e7216aad-39cb-4142-8c1f-dce1020dcc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cf0eba-47') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e95adfd0-964f-56ad-a104-d352f23175ec', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95cf0eba-47, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95cf0eba-47, col_values=(('qos', UUID('3ce20ebc-dfe7-4583-a3a2-1708bf547fd1')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95cf0eba-47, col_values=(('external_ids', {'iface-id': '95cf0eba-473a-4dfd-a3a7-1d8fec6399ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:67:cf', 'vm-uuid': '76039e5a-db02-48b4-81eb-a7383d1374b1'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: INFO os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=95cf0eba-473a-4dfd-a3a7-1d8fec6399ce,network=Network(e7216aad-39cb-4142-8c1f-dce1020dcc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cf0eba-47')
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "address": "fa:16:3e:de:4c:5a", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa8c9bd5-e4", "ovs_interfaceid": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "address": "fa:16:3e:de:4c:5a", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa8c9bd5-e4", "ovs_interfaceid": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=aa8c9bd5-e40f-45d7-addc-a0f5773791c5,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa8c9bd5-e4') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=aa8c9bd5-e40f-45d7-addc-a0f5773791c5,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa8c9bd5-e4') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c849291-8403-585e-8141-09c3b9ccdcae', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa8c9bd5-e4, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa8c9bd5-e4, col_values=(('qos', UUID('40b784f9-d91b-4361-a31d-8b07481d0f24')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa8c9bd5-e4, col_values=(('external_ids', {'iface-id': 'aa8c9bd5-e40f-45d7-addc-a0f5773791c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:4c:5a', 'vm-uuid': '76039e5a-db02-48b4-81eb-a7383d1374b1'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: INFO os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=aa8c9bd5-e40f-45d7-addc-a0f5773791c5,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa8c9bd5-e4')
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "address": "fa:16:3e:6f:10:8d", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eaa7ff-68", "ovs_interfaceid": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "address": "fa:16:3e:6f:10:8d", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eaa7ff-68", "ovs_interfaceid": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:10:8d,bridge_name='br-int',has_traffic_filtering=True,id=71eaa7ff-686b-4e1b-94b5-0b572d28e68b,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71eaa7ff-68') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:10:8d,bridge_name='br-int',has_traffic_filtering=True,id=71eaa7ff-686b-4e1b-94b5-0b572d28e68b,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71eaa7ff-68') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fc2ce60-776d-5db2-a00a-2d5af26b1c3c', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71eaa7ff-68, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71eaa7ff-68, col_values=(('qos', UUID('08257a86-243b-45a4-b9ae-208c81bf9a6e')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71eaa7ff-68, col_values=(('external_ids', {'iface-id': '71eaa7ff-686b-4e1b-94b5-0b572d28e68b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:10:8d', 'vm-uuid': '76039e5a-db02-48b4-81eb-a7383d1374b1'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: INFO os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:10:8d,bridge_name='br-int',has_traffic_filtering=True,id=71eaa7ff-686b-4e1b-94b5-0b572d28e68b,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71eaa7ff-68')
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "address": "fa:16:3e:54:87:08", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1957f9-f8", "ovs_interfaceid": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "address": "fa:16:3e:54:87:08", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1957f9-f8", "ovs_interfaceid": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:87:08,bridge_name='br-int',has_traffic_filtering=True,id=fe1957f9-f87b-4d7b-98f9-425e92dbd68d,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1957f9-f8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:87:08,bridge_name='br-int',has_traffic_filtering=True,id=fe1957f9-f87b-4d7b-98f9-425e92dbd68d,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1957f9-f8') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0079afc0-5f6f-54ca-942f-620e1bd114c3', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe1957f9-f8, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe1957f9-f8, col_values=(('qos', UUID('c7977ab6-c29e-4fc9-a749-56c581d952ab')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe1957f9-f8, col_values=(('external_ids', {'iface-id': 'fe1957f9-f87b-4d7b-98f9-425e92dbd68d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:87:08', 'vm-uuid': '76039e5a-db02-48b4-81eb-a7383d1374b1'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: INFO os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:87:08,bridge_name='br-int',has_traffic_filtering=True,id=fe1957f9-f87b-4d7b-98f9-425e92dbd68d,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1957f9-f8')
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "address": "fa:16:3e:03:49:9c", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfb2aba-69", "ovs_interfaceid": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "address": "fa:16:3e:03:49:9c", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfb2aba-69", "ovs_interfaceid": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=1bfb2aba-69ec-49d5-8875-6a2ec2049ac2,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfb2aba-69') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=1bfb2aba-69ec-49d5-8875-6a2ec2049ac2,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfb2aba-69') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45640085-5b26-5775-8ec3-f0a54dca2802', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bfb2aba-69, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bfb2aba-69, col_values=(('qos', UUID('dfbc718b-a028-460b-ac61-7aed3fa7f8c9')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bfb2aba-69, col_values=(('external_ids', {'iface-id': '1bfb2aba-69ec-49d5-8875-6a2ec2049ac2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:49:9c', 'vm-uuid': '76039e5a-db02-48b4-81eb-a7383d1374b1'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: INFO os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=1bfb2aba-69ec-49d5-8875-6a2ec2049ac2,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfb2aba-69')
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "037fd8ce-526b-4c04-bd17-4402781e28ed", "address": "fa:16:3e:d2:0b:83", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037fd8ce-52", "ovs_interfaceid": "037fd8ce-526b-4c04-bd17-4402781e28ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "037fd8ce-526b-4c04-bd17-4402781e28ed", "address": "fa:16:3e:d2:0b:83", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037fd8ce-52", "ovs_interfaceid": "037fd8ce-526b-4c04-bd17-4402781e28ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:83,bridge_name='br-int',has_traffic_filtering=True,id=037fd8ce-526b-4c04-bd17-4402781e28ed,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037fd8ce-52') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:83,bridge_name='br-int',has_traffic_filtering=True,id=037fd8ce-526b-4c04-bd17-4402781e28ed,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037fd8ce-52') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14d5c994-e1e3-5f8b-8185-da7f720ea022', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap037fd8ce-52, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap037fd8ce-52, col_values=(('qos', UUID('4e464adf-4395-4343-a3a4-125d3adf4d7b')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap037fd8ce-52, col_values=(('external_ids', {'iface-id': '037fd8ce-526b-4c04-bd17-4402781e28ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:0b:83', 'vm-uuid': '76039e5a-db02-48b4-81eb-a7383d1374b1'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: INFO os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:83,bridge_name='br-int',has_traffic_filtering=True,id=037fd8ce-526b-4c04-bd17-4402781e28ed,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037fd8ce-52')
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c34234e-daf0-44a0-8c1c-94721e415e19", "address": "fa:16:3e:e2:4b:a1", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c34234e-da", "ovs_interfaceid": "5c34234e-daf0-44a0-8c1c-94721e415e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "5c34234e-daf0-44a0-8c1c-94721e415e19", "address": "fa:16:3e:e2:4b:a1", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c34234e-da", "ovs_interfaceid": "5c34234e-daf0-44a0-8c1c-94721e415e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4b:a1,bridge_name='br-int',has_traffic_filtering=True,id=5c34234e-daf0-44a0-8c1c-94721e415e19,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c34234e-da') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4b:a1,bridge_name='br-int',has_traffic_filtering=True,id=5c34234e-daf0-44a0-8c1c-94721e415e19,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c34234e-da') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4658900-0ccf-5732-9072-ad1a7f1ab3a2', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c34234e-da, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c34234e-da, col_values=(('qos', UUID('751d1a36-eb1d-4e47-be5f-2776fe2849ad')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c34234e-da, col_values=(('external_ids', {'iface-id': '5c34234e-daf0-44a0-8c1c-94721e415e19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:4b:a1', 'vm-uuid': '76039e5a-db02-48b4-81eb-a7383d1374b1'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:02:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:02:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:50 user nova-compute[75113]: INFO os_vif [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4b:a1,bridge_name='br-int',has_traffic_filtering=True,id=5c34234e-daf0-44a0-8c1c-94721e415e19,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c34234e-da')
Oct 26 17:02:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] No BDM found with device name hda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:02:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:02:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] No VIF found with MAC fa:16:3e:62:67:cf, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:02:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] No VIF found with MAC fa:16:3e:03:49:9c, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:02:50 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Using config drive
Oct 26 17:02:50 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Creating config drive at /opt/stack/data/nova/instances/76039e5a-db02-48b4-81eb-a7383d1374b1/disk.config
Oct 26 17:02:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/76039e5a-db02-48b4-81eb-a7383d1374b1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwe7tsv1q {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:02:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/76039e5a-db02-48b4-81eb-a7383d1374b1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwe7tsv1q" returned: 0 in 0.065s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:02:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-1353c5a6-02f7-4036-885a-6885ee7dc637 req-bd622c88-6ff1-441f-990c-85694458d760 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1353c5a6-02f7-4036-885a-6885ee7dc637 req-bd622c88-6ff1-441f-990c-85694458d760 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1353c5a6-02f7-4036-885a-6885ee7dc637 req-bd622c88-6ff1-441f-990c-85694458d760 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1353c5a6-02f7-4036-885a-6885ee7dc637 req-bd622c88-6ff1-441f-990c-85694458d760 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-1353c5a6-02f7-4036-885a-6885ee7dc637 req-bd622c88-6ff1-441f-990c-85694458d760 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:52 user nova-compute[75113]: WARNING nova.compute.manager [req-1353c5a6-02f7-4036-885a-6885ee7dc637 req-bd622c88-6ff1-441f-990c-85694458d760 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce for instance with vm_state building and task_state spawning.
Oct 26 17:02:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-2b0146ad-bad8-47f1-9e9d-1796830151ab req-73e890f0-ab16-4aa1-9e33-a62938bef044 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-aa8c9bd5-e40f-45d7-addc-a0f5773791c5 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b0146ad-bad8-47f1-9e9d-1796830151ab req-73e890f0-ab16-4aa1-9e33-a62938bef044 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b0146ad-bad8-47f1-9e9d-1796830151ab req-73e890f0-ab16-4aa1-9e33-a62938bef044 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b0146ad-bad8-47f1-9e9d-1796830151ab req-73e890f0-ab16-4aa1-9e33-a62938bef044 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-2b0146ad-bad8-47f1-9e9d-1796830151ab req-73e890f0-ab16-4aa1-9e33-a62938bef044 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-aa8c9bd5-e40f-45d7-addc-a0f5773791c5 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:53 user nova-compute[75113]: WARNING nova.compute.manager [req-2b0146ad-bad8-47f1-9e9d-1796830151ab req-73e890f0-ab16-4aa1-9e33-a62938bef044 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-aa8c9bd5-e40f-45d7-addc-a0f5773791c5 for instance with vm_state building and task_state spawning.
Oct 26 17:02:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:55 user nova-compute[75113]: WARNING nova.compute.manager [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce for instance with vm_state building and task_state spawning.
Oct 26 17:02:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-fe1957f9-f87b-4d7b-98f9-425e92dbd68d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-fe1957f9-f87b-4d7b-98f9-425e92dbd68d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:55 user nova-compute[75113]: WARNING nova.compute.manager [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-fe1957f9-f87b-4d7b-98f9-425e92dbd68d for instance with vm_state building and task_state spawning.
Oct 26 17:02:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-fe1957f9-f87b-4d7b-98f9-425e92dbd68d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-fe1957f9-f87b-4d7b-98f9-425e92dbd68d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:55 user nova-compute[75113]: WARNING nova.compute.manager [req-6dd7cc2a-f731-41a0-b812-15ace0a7b978 req-9be38698-3cc5-4a4e-b685-2a443b8e9bd4 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-fe1957f9-f87b-4d7b-98f9-425e92dbd68d for instance with vm_state building and task_state spawning.
Oct 26 17:02:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-aa8c9bd5-e40f-45d7-addc-a0f5773791c5 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-aa8c9bd5-e40f-45d7-addc-a0f5773791c5 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:55 user nova-compute[75113]: WARNING nova.compute.manager [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-aa8c9bd5-e40f-45d7-addc-a0f5773791c5 for instance with vm_state building and task_state spawning.
Oct 26 17:02:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-5c34234e-daf0-44a0-8c1c-94721e415e19 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-5c34234e-daf0-44a0-8c1c-94721e415e19 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:55 user nova-compute[75113]: WARNING nova.compute.manager [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-5c34234e-daf0-44a0-8c1c-94721e415e19 for instance with vm_state building and task_state spawning.
Oct 26 17:02:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-5c34234e-daf0-44a0-8c1c-94721e415e19 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-5c34234e-daf0-44a0-8c1c-94721e415e19 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:55 user nova-compute[75113]: WARNING nova.compute.manager [req-928f804d-1ba1-48dc-97fd-4a82f9b13896 req-9d155f1d-b0d6-4071-8a40-df44ca9ef6f7 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-5c34234e-daf0-44a0-8c1c-94721e415e19 for instance with vm_state building and task_state spawning.
Oct 26 17:02:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-1140885a-4c68-4780-9915-355a2deb9253 req-7eab9348-f845-4dda-86f4-3b8631c225c5 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-71eaa7ff-686b-4e1b-94b5-0b572d28e68b {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1140885a-4c68-4780-9915-355a2deb9253 req-7eab9348-f845-4dda-86f4-3b8631c225c5 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1140885a-4c68-4780-9915-355a2deb9253 req-7eab9348-f845-4dda-86f4-3b8631c225c5 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1140885a-4c68-4780-9915-355a2deb9253 req-7eab9348-f845-4dda-86f4-3b8631c225c5 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-1140885a-4c68-4780-9915-355a2deb9253 req-7eab9348-f845-4dda-86f4-3b8631c225c5 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-71eaa7ff-686b-4e1b-94b5-0b572d28e68b {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:56 user nova-compute[75113]: WARNING nova.compute.manager [req-1140885a-4c68-4780-9915-355a2deb9253 req-7eab9348-f845-4dda-86f4-3b8631c225c5 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-71eaa7ff-686b-4e1b-94b5-0b572d28e68b for instance with vm_state building and task_state spawning.
Oct 26 17:02:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:02:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:02:57 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Instance spawned successfully.
Oct 26 17:02:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:02:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:02:57 user nova-compute[75113]: INFO nova.compute.manager [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Took 12.70 seconds to spawn the instance on the hypervisor.
Oct 26 17:02:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:02:57 user nova-compute[75113]: INFO nova.compute.manager [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Took 129.82 seconds to build instance.
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6182990f-4c67-4b42-b18d-5c21c786de90 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 129.953s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 122.149s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:58 user nova-compute[75113]: INFO nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-71eaa7ff-686b-4e1b-94b5-0b572d28e68b {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-71eaa7ff-686b-4e1b-94b5-0b572d28e68b {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:58 user nova-compute[75113]: WARNING nova.compute.manager [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-71eaa7ff-686b-4e1b-94b5-0b572d28e68b for instance with vm_state active and task_state None.
Oct 26 17:02:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:58 user nova-compute[75113]: WARNING nova.compute.manager [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 for instance with vm_state active and task_state None.
Oct 26 17:02:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:58 user nova-compute[75113]: WARNING nova.compute.manager [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 for instance with vm_state active and task_state None.
Oct 26 17:02:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-037fd8ce-526b-4c04-bd17-4402781e28ed {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:02:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-037fd8ce-526b-4c04-bd17-4402781e28ed {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:02:58 user nova-compute[75113]: WARNING nova.compute.manager [req-b4b0f524-8203-4954-a55a-92f17e83571b req-f2cfed22-4eba-47f7-a1ae-1372fa182f4d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-037fd8ce-526b-4c04-bd17-4402781e28ed for instance with vm_state active and task_state None.
Oct 26 17:03:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:03:00 user nova-compute[75113]: INFO nova.compute.claims [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Claim successful on node user
Oct 26 17:03:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-3513e375-2521-4a1d-9a8c-058854e5f3c0 req-27986019-ba4a-4cf6-a3bc-b289f6b955c9 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-037fd8ce-526b-4c04-bd17-4402781e28ed {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3513e375-2521-4a1d-9a8c-058854e5f3c0 req-27986019-ba4a-4cf6-a3bc-b289f6b955c9 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3513e375-2521-4a1d-9a8c-058854e5f3c0 req-27986019-ba4a-4cf6-a3bc-b289f6b955c9 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3513e375-2521-4a1d-9a8c-058854e5f3c0 req-27986019-ba4a-4cf6-a3bc-b289f6b955c9 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-3513e375-2521-4a1d-9a8c-058854e5f3c0 req-27986019-ba4a-4cf6-a3bc-b289f6b955c9 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-037fd8ce-526b-4c04-bd17-4402781e28ed {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:03:00 user nova-compute[75113]: WARNING nova.compute.manager [req-3513e375-2521-4a1d-9a8c-058854e5f3c0 req-27986019-ba4a-4cf6-a3bc-b289f6b955c9 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-037fd8ce-526b-4c04-bd17-4402781e28ed for instance with vm_state active and task_state None.
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.864s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.860s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:03:01 user nova-compute[75113]: INFO nova.compute.claims [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Claim successful on node user
Oct 26 17:03:01 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.network.neutron [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:03:01 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.policy [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be611f9c83184dc29d232904a828b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e63bbd8ed7e4fc189d54c828d43e445', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:03:01 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Creating image(s)
Oct 26 17:03:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "/opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "/opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "/opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.322s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:03:01 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.836s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.267s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:02 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk 1073741824" returned: 0 in 0.067s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.policy [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c81e83d3ea04b2a8dabe3ac53205391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786feb5d295e40868b844a95c26cf661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.221s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updating instance_info_cache with network_info: [{"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:03:02 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Creating image(s)
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "/opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "/opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "/opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.network.neutron [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Successfully created port: e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Cannot resize image /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Ensure instance console log exists: /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.238s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.242s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk 1073741824" returned: 0 in 0.073s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.230s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Successfully created port: 5ccc0af1-e477-4bc0-914b-7229f64a9c0b {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.network.neutron [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Successfully updated port: e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "refresh_cache-b07d5f6f-8994-46a8-8c80-c0b803c894b0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquired lock "refresh_cache-b07d5f6f-8994-46a8-8c80-c0b803c894b0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.network.neutron [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-3374e546-a515-4e09-9ecd-f8c450618224 req-8045f0ed-f33b-4d03-a886-b4295b38a95b service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received event network-changed-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-3374e546-a515-4e09-9ecd-f8c450618224 req-8045f0ed-f33b-4d03-a886-b4295b38a95b service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Refreshing instance network info cache due to event network-changed-e8551569-369f-4dfc-a57e-c1c06ed135bf. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3374e546-a515-4e09-9ecd-f8c450618224 req-8045f0ed-f33b-4d03-a886-b4295b38a95b service nova] Acquiring lock "refresh_cache-b07d5f6f-8994-46a8-8c80-c0b803c894b0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Cannot resize image /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Ensure instance console log exists: /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.network.neutron [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.network.neutron [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Updating instance_info_cache with network_info: [{"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Releasing lock "refresh_cache-b07d5f6f-8994-46a8-8c80-c0b803c894b0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Instance network_info: |[{"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3374e546-a515-4e09-9ecd-f8c450618224 req-8045f0ed-f33b-4d03-a886-b4295b38a95b service nova] Acquired lock "refresh_cache-b07d5f6f-8994-46a8-8c80-c0b803c894b0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.network.neutron [req-3374e546-a515-4e09-9ecd-f8c450618224 req-8045f0ed-f33b-4d03-a886-b4295b38a95b service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Refreshing network info cache for port e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Start _get_guest_xml network_info=[{"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:03:03 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:03:03 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:03:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-344642576',display_name='tempest-tempest.common.compute-instance-344642576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-344642576',id=21,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKDgMEMkpFlH8KZx6RrwYwMvXxYdxXkahHL23zoh9+5s6eqdjgg+Ebr255x4MvsxDhjqzswkbnJBfDeEKclFqpSIgvgAFmGk/YzRnMisxnzZSlJhLo3ijX43KEIBuel7A==',key_name='tempest-keypair-1377389928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-hpcm4pye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:03:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=b07d5f6f-8994-46a8-8c80-c0b803c894b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lazy-loading 'pci_devices' on Instance uuid b07d5f6f-8994-46a8-8c80-c0b803c894b0 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:03:04 user nova-compute[75113]:   <uuid>b07d5f6f-8994-46a8-8c80-c0b803c894b0</uuid>
Oct 26 17:03:04 user nova-compute[75113]:   <name>instance-00000015</name>
Oct 26 17:03:04 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:03:04 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:03:04 user nova-compute[75113]:   <metadata>
Oct 26 17:03:04 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:03:04 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:03:04 user nova-compute[75113]:       <nova:name>tempest-tempest.common.compute-instance-344642576</nova:name>
Oct 26 17:03:04 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:03:03</nova:creationTime>
Oct 26 17:03:04 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:03:04 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:03:04 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:03:04 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:03:04 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:03:04 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:03:04 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:03:04 user nova-compute[75113]:       <nova:owner>
Oct 26 17:03:04 user nova-compute[75113]:         <nova:user uuid="be611f9c83184dc29d232904a828b12a">tempest-ServerActionsTestOtherA-2074512325-project-member</nova:user>
Oct 26 17:03:04 user nova-compute[75113]:         <nova:project uuid="5e63bbd8ed7e4fc189d54c828d43e445">tempest-ServerActionsTestOtherA-2074512325</nova:project>
Oct 26 17:03:04 user nova-compute[75113]:       </nova:owner>
Oct 26 17:03:04 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:03:04 user nova-compute[75113]:       <nova:ports>
Oct 26 17:03:04 user nova-compute[75113]:         <nova:port uuid="e8551569-369f-4dfc-a57e-c1c06ed135bf">
Oct 26 17:03:04 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 17:03:04 user nova-compute[75113]:         </nova:port>
Oct 26 17:03:04 user nova-compute[75113]:       </nova:ports>
Oct 26 17:03:04 user nova-compute[75113]:     </nova:instance>
Oct 26 17:03:04 user nova-compute[75113]:   </metadata>
Oct 26 17:03:04 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:03:04 user nova-compute[75113]:     <system>
Oct 26 17:03:04 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:03:04 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:03:04 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:03:04 user nova-compute[75113]:       <entry name="serial">b07d5f6f-8994-46a8-8c80-c0b803c894b0</entry>
Oct 26 17:03:04 user nova-compute[75113]:       <entry name="uuid">b07d5f6f-8994-46a8-8c80-c0b803c894b0</entry>
Oct 26 17:03:04 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:03:04 user nova-compute[75113]:     </system>
Oct 26 17:03:04 user nova-compute[75113]:   </sysinfo>
Oct 26 17:03:04 user nova-compute[75113]:   <os>
Oct 26 17:03:04 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:03:04 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:03:04 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:03:04 user nova-compute[75113]:   </os>
Oct 26 17:03:04 user nova-compute[75113]:   <features>
Oct 26 17:03:04 user nova-compute[75113]:     <acpi/>
Oct 26 17:03:04 user nova-compute[75113]:     <apic/>
Oct 26 17:03:04 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:03:04 user nova-compute[75113]:   </features>
Oct 26 17:03:04 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:03:04 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:03:04 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:03:04 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:03:04 user nova-compute[75113]:   </clock>
Oct 26 17:03:04 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:03:04 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:03:04 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:03:04 user nova-compute[75113]:   </cpu>
Oct 26 17:03:04 user nova-compute[75113]:   <devices>
Oct 26 17:03:04 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:03:04 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:03:04 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk"/>
Oct 26 17:03:04 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:03:04 user nova-compute[75113]:     </disk>
Oct 26 17:03:04 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:03:04 user nova-compute[75113]:       <mac address="fa:16:3e:ab:4a:42"/>
Oct 26 17:03:04 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:03:04 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:03:04 user nova-compute[75113]:       <target dev="tape8551569-36"/>
Oct 26 17:03:04 user nova-compute[75113]:     </interface>
Oct 26 17:03:04 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:03:04 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/console.log" append="off"/>
Oct 26 17:03:04 user nova-compute[75113]:     </serial>
Oct 26 17:03:04 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:03:04 user nova-compute[75113]:     <video>
Oct 26 17:03:04 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:03:04 user nova-compute[75113]:     </video>
Oct 26 17:03:04 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:03:04 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:03:04 user nova-compute[75113]:     </rng>
Oct 26 17:03:04 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:03:04 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:03:04 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:03:04 user nova-compute[75113]:     </memballoon>
Oct 26 17:03:04 user nova-compute[75113]:   </devices>
Oct 26 17:03:04 user nova-compute[75113]: </domain>
Oct 26 17:03:04 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-344642576',display_name='tempest-tempest.common.compute-instance-344642576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-344642576',id=21,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKDgMEMkpFlH8KZx6RrwYwMvXxYdxXkahHL23zoh9+5s6eqdjgg+Ebr255x4MvsxDhjqzswkbnJBfDeEKclFqpSIgvgAFmGk/YzRnMisxnzZSlJhLo3ijX43KEIBuel7A==',key_name='tempest-keypair-1377389928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-hpcm4pye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:03:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=b07d5f6f-8994-46a8-8c80-c0b803c894b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG os_vif [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ca800d6-9c37-5e05-817c-2dac2bb43bab', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8551569-36, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8551569-36, col_values=(('qos', UUID('58689f77-2cce-42fe-87c9-bc9dfb308d62')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8551569-36, col_values=(('external_ids', {'iface-id': 'e8551569-369f-4dfc-a57e-c1c06ed135bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:4a:42', 'vm-uuid': 'b07d5f6f-8994-46a8-8c80-c0b803c894b0'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:04 user nova-compute[75113]: INFO os_vif [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36')
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No VIF found with MAC fa:16:3e:ab:4a:42, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.network.neutron [req-3374e546-a515-4e09-9ecd-f8c450618224 req-8045f0ed-f33b-4d03-a886-b4295b38a95b service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Updated VIF entry in instance network info cache for port e8551569-369f-4dfc-a57e-c1c06ed135bf. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.network.neutron [req-3374e546-a515-4e09-9ecd-f8c450618224 req-8045f0ed-f33b-4d03-a886-b4295b38a95b service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Updating instance_info_cache with network_info: [{"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3374e546-a515-4e09-9ecd-f8c450618224 req-8045f0ed-f33b-4d03-a886-b4295b38a95b service nova] Releasing lock "refresh_cache-b07d5f6f-8994-46a8-8c80-c0b803c894b0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Successfully updated port: 5ccc0af1-e477-4bc0-914b-7229f64a9c0b {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "refresh_cache-35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquired lock "refresh_cache-35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-89765bfe-89d8-4594-b50a-197e2657bf32 req-b90fa627-63f1-40fc-a396-5424866055f0 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Received event network-changed-5ccc0af1-e477-4bc0-914b-7229f64a9c0b {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-89765bfe-89d8-4594-b50a-197e2657bf32 req-b90fa627-63f1-40fc-a396-5424866055f0 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Refreshing instance network info cache due to event network-changed-5ccc0af1-e477-4bc0-914b-7229f64a9c0b. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-89765bfe-89d8-4594-b50a-197e2657bf32 req-b90fa627-63f1-40fc-a396-5424866055f0 service nova] Acquiring lock "refresh_cache-35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:03:04 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:03:05 user nova-compute[75113]: INFO nova.compute.claims [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Claim successful on node user
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Updating instance_info_cache with network_info: [{"id": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "address": "fa:16:3e:cc:a6:4d", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc0af1-e4", "ovs_interfaceid": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Releasing lock "refresh_cache-35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Instance network_info: |[{"id": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "address": "fa:16:3e:cc:a6:4d", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc0af1-e4", "ovs_interfaceid": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-89765bfe-89d8-4594-b50a-197e2657bf32 req-b90fa627-63f1-40fc-a396-5424866055f0 service nova] Acquired lock "refresh_cache-35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.network.neutron [req-89765bfe-89d8-4594-b50a-197e2657bf32 req-b90fa627-63f1-40fc-a396-5424866055f0 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Refreshing network info cache for port 5ccc0af1-e477-4bc0-914b-7229f64a9c0b {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Start _get_guest_xml network_info=[{"id": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "address": "fa:16:3e:cc:a6:4d", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc0af1-e4", "ovs_interfaceid": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:03:05 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:03:05 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2070001326',display_name='tempest-ServersNegativeTestJSON-server-2070001326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2070001326',id=22,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='786feb5d295e40868b844a95c26cf661',ramdisk_id='',reservation_id='r-bekudl6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1640105602',owner_user_name='tempest-ServersNegativeTestJSON-1640105602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:03:02Z,user_data=None,user_id='0c81e83d3ea04b2a8dabe3ac53205391',uuid=35eb4735-4d81-4e5b-8f8c-70ea7750dcc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "address": "fa:16:3e:cc:a6:4d", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc0af1-e4", "ovs_interfaceid": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Converting VIF {"id": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "address": "fa:16:3e:cc:a6:4d", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc0af1-e4", "ovs_interfaceid": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=5ccc0af1-e477-4bc0-914b-7229f64a9c0b,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc0af1-e4') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.objects.instance [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lazy-loading 'pci_devices' on Instance uuid 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:03:05 user nova-compute[75113]:   <uuid>35eb4735-4d81-4e5b-8f8c-70ea7750dcc4</uuid>
Oct 26 17:03:05 user nova-compute[75113]:   <name>instance-00000016</name>
Oct 26 17:03:05 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:03:05 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:03:05 user nova-compute[75113]:   <metadata>
Oct 26 17:03:05 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:03:05 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:03:05 user nova-compute[75113]:       <nova:name>tempest-ServersNegativeTestJSON-server-2070001326</nova:name>
Oct 26 17:03:05 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:03:05</nova:creationTime>
Oct 26 17:03:05 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:03:05 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:03:05 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:03:05 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:03:05 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:03:05 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:03:05 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:03:05 user nova-compute[75113]:       <nova:owner>
Oct 26 17:03:05 user nova-compute[75113]:         <nova:user uuid="0c81e83d3ea04b2a8dabe3ac53205391">tempest-ServersNegativeTestJSON-1640105602-project-member</nova:user>
Oct 26 17:03:05 user nova-compute[75113]:         <nova:project uuid="786feb5d295e40868b844a95c26cf661">tempest-ServersNegativeTestJSON-1640105602</nova:project>
Oct 26 17:03:05 user nova-compute[75113]:       </nova:owner>
Oct 26 17:03:05 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:03:05 user nova-compute[75113]:       <nova:ports>
Oct 26 17:03:05 user nova-compute[75113]:         <nova:port uuid="5ccc0af1-e477-4bc0-914b-7229f64a9c0b">
Oct 26 17:03:05 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 17:03:05 user nova-compute[75113]:         </nova:port>
Oct 26 17:03:05 user nova-compute[75113]:       </nova:ports>
Oct 26 17:03:05 user nova-compute[75113]:     </nova:instance>
Oct 26 17:03:05 user nova-compute[75113]:   </metadata>
Oct 26 17:03:05 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:03:05 user nova-compute[75113]:     <system>
Oct 26 17:03:05 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:03:05 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:03:05 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:03:05 user nova-compute[75113]:       <entry name="serial">35eb4735-4d81-4e5b-8f8c-70ea7750dcc4</entry>
Oct 26 17:03:05 user nova-compute[75113]:       <entry name="uuid">35eb4735-4d81-4e5b-8f8c-70ea7750dcc4</entry>
Oct 26 17:03:05 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:03:05 user nova-compute[75113]:     </system>
Oct 26 17:03:05 user nova-compute[75113]:   </sysinfo>
Oct 26 17:03:05 user nova-compute[75113]:   <os>
Oct 26 17:03:05 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:03:05 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:03:05 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:03:05 user nova-compute[75113]:   </os>
Oct 26 17:03:05 user nova-compute[75113]:   <features>
Oct 26 17:03:05 user nova-compute[75113]:     <acpi/>
Oct 26 17:03:05 user nova-compute[75113]:     <apic/>
Oct 26 17:03:05 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:03:05 user nova-compute[75113]:   </features>
Oct 26 17:03:05 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:03:05 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:03:05 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:03:05 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:03:05 user nova-compute[75113]:   </clock>
Oct 26 17:03:05 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:03:05 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:03:05 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:03:05 user nova-compute[75113]:   </cpu>
Oct 26 17:03:05 user nova-compute[75113]:   <devices>
Oct 26 17:03:05 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:03:05 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:03:05 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk"/>
Oct 26 17:03:05 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:03:05 user nova-compute[75113]:     </disk>
Oct 26 17:03:05 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:03:05 user nova-compute[75113]:       <mac address="fa:16:3e:cc:a6:4d"/>
Oct 26 17:03:05 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:03:05 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:03:05 user nova-compute[75113]:       <target dev="tap5ccc0af1-e4"/>
Oct 26 17:03:05 user nova-compute[75113]:     </interface>
Oct 26 17:03:05 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:03:05 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/console.log" append="off"/>
Oct 26 17:03:05 user nova-compute[75113]:     </serial>
Oct 26 17:03:05 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:03:05 user nova-compute[75113]:     <video>
Oct 26 17:03:05 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:03:05 user nova-compute[75113]:     </video>
Oct 26 17:03:05 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:03:05 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:03:05 user nova-compute[75113]:     </rng>
Oct 26 17:03:05 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:03:05 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:03:05 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:03:05 user nova-compute[75113]:     </memballoon>
Oct 26 17:03:05 user nova-compute[75113]:   </devices>
Oct 26 17:03:05 user nova-compute[75113]: </domain>
Oct 26 17:03:05 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2070001326',display_name='tempest-ServersNegativeTestJSON-server-2070001326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2070001326',id=22,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='786feb5d295e40868b844a95c26cf661',ramdisk_id='',reservation_id='r-bekudl6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1640105602',owner_user_name='tempest-ServersNegativeTestJSON-1640105602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:03:02Z,user_data=None,user_id='0c81e83d3ea04b2a8dabe3ac53205391',uuid=35eb4735-4d81-4e5b-8f8c-70ea7750dcc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "address": "fa:16:3e:cc:a6:4d", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc0af1-e4", "ovs_interfaceid": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Converting VIF {"id": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "address": "fa:16:3e:cc:a6:4d", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc0af1-e4", "ovs_interfaceid": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=5ccc0af1-e477-4bc0-914b-7229f64a9c0b,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc0af1-e4') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG os_vif [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=5ccc0af1-e477-4bc0-914b-7229f64a9c0b,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc0af1-e4') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0de73891-203c-594a-9a04-81ebee8839d7', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ccc0af1-e4, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ccc0af1-e4, col_values=(('qos', UUID('de6f4451-12cb-4d10-919e-88198b4229eb')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ccc0af1-e4, col_values=(('external_ids', {'iface-id': '5ccc0af1-e477-4bc0-914b-7229f64a9c0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:a6:4d', 'vm-uuid': '35eb4735-4d81-4e5b-8f8c-70ea7750dcc4'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:05 user nova-compute[75113]: INFO os_vif [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=5ccc0af1-e477-4bc0-914b-7229f64a9c0b,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc0af1-e4')
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] No VIF found with MAC fa:16:3e:cc:a6:4d, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.746s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:03:05 user nova-compute[75113]: DEBUG nova.network.neutron [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:03:06 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:03:06 user nova-compute[75113]: DEBUG nova.compute.manager [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:03:06 user nova-compute[75113]: INFO nova.compute.claims [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Claim successful on node user
Oct 26 17:03:06 user nova-compute[75113]: DEBUG nova.policy [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5aa8e21aab014ce6ace0109878275b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d11c5d88b2f4a45acee2e9c7d26043a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG nova.network.neutron [req-89765bfe-89d8-4594-b50a-197e2657bf32 req-b90fa627-63f1-40fc-a396-5424866055f0 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Updated VIF entry in instance network info cache for port 5ccc0af1-e477-4bc0-914b-7229f64a9c0b. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG nova.network.neutron [req-89765bfe-89d8-4594-b50a-197e2657bf32 req-b90fa627-63f1-40fc-a396-5424866055f0 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Updating instance_info_cache with network_info: [{"id": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "address": "fa:16:3e:cc:a6:4d", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc0af1-e4", "ovs_interfaceid": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-89765bfe-89d8-4594-b50a-197e2657bf32 req-b90fa627-63f1-40fc-a396-5424866055f0 service nova] Releasing lock "refresh_cache-35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG nova.compute.manager [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:03:06 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Creating image(s)
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "/opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "/opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.231s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.289s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk 1073741824" returned: 0 in 0.082s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.376s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.893s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG nova.compute.manager [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:03:06 user nova-compute[75113]: DEBUG nova.network.neutron [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Successfully created port: a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.compute.manager [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.network.neutron [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:03:07 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.compute.manager [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.263s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.policy [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5aa8e21aab014ce6ace0109878275b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d11c5d88b2f4a45acee2e9c7d26043a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.compute.manager [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:03:07 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Creating image(s)
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "/opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "/opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "/opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Cannot resize image /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Ensure instance console log exists: /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.205s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.266s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.network.neutron [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Successfully updated port: a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-f9c72d64-bb52-458b-92e2-4081342f9124 req-ab4ca104-6fcc-443c-89cf-fc119552af59 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-changed-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-f9c72d64-bb52-458b-92e2-4081342f9124 req-ab4ca104-6fcc-443c-89cf-fc119552af59 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Refreshing instance network info cache due to event network-changed-a5db72c5-5814-4a7d-850b-3cc9292bf6d1. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f9c72d64-bb52-458b-92e2-4081342f9124 req-ab4ca104-6fcc-443c-89cf-fc119552af59 service nova] Acquiring lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f9c72d64-bb52-458b-92e2-4081342f9124 req-ab4ca104-6fcc-443c-89cf-fc119552af59 service nova] Acquired lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG nova.network.neutron [req-f9c72d64-bb52-458b-92e2-4081342f9124 req-ab4ca104-6fcc-443c-89cf-fc119552af59 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Refreshing network info cache for port a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk 1073741824" returned: 0 in 0.089s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.compute.manager [req-9311df9c-0f80-43c4-8187-5cecf713553a req-f3c3c9ce-b8a2-414e-b75b-223783f054d5 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received event network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9311df9c-0f80-43c4-8187-5cecf713553a req-f3c3c9ce-b8a2-414e-b75b-223783f054d5 service nova] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9311df9c-0f80-43c4-8187-5cecf713553a req-f3c3c9ce-b8a2-414e-b75b-223783f054d5 service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9311df9c-0f80-43c4-8187-5cecf713553a req-f3c3c9ce-b8a2-414e-b75b-223783f054d5 service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.compute.manager [req-9311df9c-0f80-43c4-8187-5cecf713553a req-f3c3c9ce-b8a2-414e-b75b-223783f054d5 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] No waiting events found dispatching network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:03:08 user nova-compute[75113]: WARNING nova.compute.manager [req-9311df9c-0f80-43c4-8187-5cecf713553a req-f3c3c9ce-b8a2-414e-b75b-223783f054d5 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received unexpected event network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf for instance with vm_state building and task_state spawning.
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.network.neutron [req-f9c72d64-bb52-458b-92e2-4081342f9124 req-ab4ca104-6fcc-443c-89cf-fc119552af59 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.network.neutron [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Successfully created port: 03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.268s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.network.neutron [req-f9c72d64-bb52-458b-92e2-4081342f9124 req-ab4ca104-6fcc-443c-89cf-fc119552af59 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f9c72d64-bb52-458b-92e2-4081342f9124 req-ab4ca104-6fcc-443c-89cf-fc119552af59 service nova] Releasing lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquired lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.network.neutron [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Cannot resize image /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Ensure instance console log exists: /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.network.neutron [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.network.neutron [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Updating instance_info_cache with network_info: [{"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Releasing lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.compute.manager [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Instance network_info: |[{"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Start _get_guest_xml network_info=[{"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:03:08 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:03:08 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1018610013',display_name='tempest-ServerRescueNegativeTestJSON-server-1018610013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1018610013',id=23,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d11c5d88b2f4a45acee2e9c7d26043a',ramdisk_id='',reservation_id='r-z45ooa2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760587308',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760587308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:03:06Z,user_data=None,user_id='5aa8e21aab014ce6ace0109878275b8f',uuid=bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converting VIF {"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=a5db72c5-5814-4a7d-850b-3cc9292bf6d1,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5db72c5-58') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.objects.instance [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'pci_devices' on Instance uuid bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:03:08 user nova-compute[75113]:   <uuid>bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df</uuid>
Oct 26 17:03:08 user nova-compute[75113]:   <name>instance-00000017</name>
Oct 26 17:03:08 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:03:08 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:03:08 user nova-compute[75113]:   <metadata>
Oct 26 17:03:08 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:03:08 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:03:08 user nova-compute[75113]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1018610013</nova:name>
Oct 26 17:03:08 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:03:08</nova:creationTime>
Oct 26 17:03:08 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:03:08 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:03:08 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:03:08 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:03:08 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:03:08 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:03:08 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:03:08 user nova-compute[75113]:       <nova:owner>
Oct 26 17:03:08 user nova-compute[75113]:         <nova:user uuid="5aa8e21aab014ce6ace0109878275b8f">tempest-ServerRescueNegativeTestJSON-1760587308-project-member</nova:user>
Oct 26 17:03:08 user nova-compute[75113]:         <nova:project uuid="2d11c5d88b2f4a45acee2e9c7d26043a">tempest-ServerRescueNegativeTestJSON-1760587308</nova:project>
Oct 26 17:03:08 user nova-compute[75113]:       </nova:owner>
Oct 26 17:03:08 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:03:08 user nova-compute[75113]:       <nova:ports>
Oct 26 17:03:08 user nova-compute[75113]:         <nova:port uuid="a5db72c5-5814-4a7d-850b-3cc9292bf6d1">
Oct 26 17:03:08 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 17:03:08 user nova-compute[75113]:         </nova:port>
Oct 26 17:03:08 user nova-compute[75113]:       </nova:ports>
Oct 26 17:03:08 user nova-compute[75113]:     </nova:instance>
Oct 26 17:03:08 user nova-compute[75113]:   </metadata>
Oct 26 17:03:08 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:03:08 user nova-compute[75113]:     <system>
Oct 26 17:03:08 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:03:08 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:03:08 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:03:08 user nova-compute[75113]:       <entry name="serial">bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df</entry>
Oct 26 17:03:08 user nova-compute[75113]:       <entry name="uuid">bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df</entry>
Oct 26 17:03:08 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:03:08 user nova-compute[75113]:     </system>
Oct 26 17:03:08 user nova-compute[75113]:   </sysinfo>
Oct 26 17:03:08 user nova-compute[75113]:   <os>
Oct 26 17:03:08 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:03:08 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:03:08 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:03:08 user nova-compute[75113]:   </os>
Oct 26 17:03:08 user nova-compute[75113]:   <features>
Oct 26 17:03:08 user nova-compute[75113]:     <acpi/>
Oct 26 17:03:08 user nova-compute[75113]:     <apic/>
Oct 26 17:03:08 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:03:08 user nova-compute[75113]:   </features>
Oct 26 17:03:08 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:03:08 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:03:08 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:03:08 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:03:08 user nova-compute[75113]:   </clock>
Oct 26 17:03:08 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:03:08 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:03:08 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:03:08 user nova-compute[75113]:   </cpu>
Oct 26 17:03:08 user nova-compute[75113]:   <devices>
Oct 26 17:03:08 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:03:08 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:03:08 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk"/>
Oct 26 17:03:08 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:03:08 user nova-compute[75113]:     </disk>
Oct 26 17:03:08 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:03:08 user nova-compute[75113]:       <mac address="fa:16:3e:9e:d5:a5"/>
Oct 26 17:03:08 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:03:08 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:03:08 user nova-compute[75113]:       <target dev="tapa5db72c5-58"/>
Oct 26 17:03:08 user nova-compute[75113]:     </interface>
Oct 26 17:03:08 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:03:08 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/console.log" append="off"/>
Oct 26 17:03:08 user nova-compute[75113]:     </serial>
Oct 26 17:03:08 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:03:08 user nova-compute[75113]:     <video>
Oct 26 17:03:08 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:03:08 user nova-compute[75113]:     </video>
Oct 26 17:03:08 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:03:08 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:03:08 user nova-compute[75113]:     </rng>
Oct 26 17:03:08 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:03:08 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:03:08 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:03:08 user nova-compute[75113]:     </memballoon>
Oct 26 17:03:08 user nova-compute[75113]:   </devices>
Oct 26 17:03:08 user nova-compute[75113]: </domain>
Oct 26 17:03:08 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1018610013',display_name='tempest-ServerRescueNegativeTestJSON-server-1018610013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1018610013',id=23,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d11c5d88b2f4a45acee2e9c7d26043a',ramdisk_id='',reservation_id='r-z45ooa2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760587308',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760587308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:03:06Z,user_data=None,user_id='5aa8e21aab014ce6ace0109878275b8f',uuid=bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converting VIF {"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=a5db72c5-5814-4a7d-850b-3cc9292bf6d1,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5db72c5-58') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG os_vif [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=a5db72c5-5814-4a7d-850b-3cc9292bf6d1,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5db72c5-58') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0372a3ae-4782-557c-8f4d-5ddc068814d5', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5db72c5-58, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5db72c5-58, col_values=(('qos', UUID('1da239c2-3847-4f2f-9bc8-832029f1d459')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5db72c5-58, col_values=(('external_ids', {'iface-id': 'a5db72c5-5814-4a7d-850b-3cc9292bf6d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:d5:a5', 'vm-uuid': 'bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:09 user nova-compute[75113]: INFO os_vif [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=a5db72c5-5814-4a7d-850b-3cc9292bf6d1,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5db72c5-58')
Oct 26 17:03:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No VIF found with MAC fa:16:3e:9e:d5:a5, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.network.neutron [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Successfully updated port: 03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquired lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.network.neutron [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.network.neutron [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-f08df503-d397-484e-a7c3-cc992a7b9143 req-1ed2b039-a08a-4296-9857-162e5f676343 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-changed-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-f08df503-d397-484e-a7c3-cc992a7b9143 req-1ed2b039-a08a-4296-9857-162e5f676343 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Refreshing instance network info cache due to event network-changed-03fed87a-c881-4ca6-85a3-4440a97ddd8c. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f08df503-d397-484e-a7c3-cc992a7b9143 req-1ed2b039-a08a-4296-9857-162e5f676343 service nova] Acquiring lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.network.neutron [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Updating instance_info_cache with network_info: [{"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:09 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Instance spawned successfully.
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Releasing lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.compute.manager [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Instance network_info: |[{"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f08df503-d397-484e-a7c3-cc992a7b9143 req-1ed2b039-a08a-4296-9857-162e5f676343 service nova] Acquired lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.network.neutron [req-f08df503-d397-484e-a7c3-cc992a7b9143 req-1ed2b039-a08a-4296-9857-162e5f676343 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Refreshing network info cache for port 03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Start _get_guest_xml network_info=[{"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:09 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:03:09 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:03:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1323343316',display_name='tempest-ServerRescueNegativeTestJSON-server-1323343316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1323343316',id=24,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d11c5d88b2f4a45acee2e9c7d26043a',ramdisk_id='',reservation_id='r-oxsm407w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760587308',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760587308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:03:07Z,user_data=None,user_id='5aa8e21aab014ce6ace0109878275b8f',uuid=5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converting VIF {"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=03fed87a-c881-4ca6-85a3-4440a97ddd8c,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fed87a-c8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.objects.instance [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'pci_devices' on Instance uuid 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:03:10 user nova-compute[75113]:   <uuid>5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88</uuid>
Oct 26 17:03:10 user nova-compute[75113]:   <name>instance-00000018</name>
Oct 26 17:03:10 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:03:10 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:03:10 user nova-compute[75113]:   <metadata>
Oct 26 17:03:10 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:03:10 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:03:10 user nova-compute[75113]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1323343316</nova:name>
Oct 26 17:03:10 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:03:09</nova:creationTime>
Oct 26 17:03:10 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:03:10 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:03:10 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:03:10 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:03:10 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:03:10 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:03:10 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:03:10 user nova-compute[75113]:       <nova:owner>
Oct 26 17:03:10 user nova-compute[75113]:         <nova:user uuid="5aa8e21aab014ce6ace0109878275b8f">tempest-ServerRescueNegativeTestJSON-1760587308-project-member</nova:user>
Oct 26 17:03:10 user nova-compute[75113]:         <nova:project uuid="2d11c5d88b2f4a45acee2e9c7d26043a">tempest-ServerRescueNegativeTestJSON-1760587308</nova:project>
Oct 26 17:03:10 user nova-compute[75113]:       </nova:owner>
Oct 26 17:03:10 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:03:10 user nova-compute[75113]:       <nova:ports>
Oct 26 17:03:10 user nova-compute[75113]:         <nova:port uuid="03fed87a-c881-4ca6-85a3-4440a97ddd8c">
Oct 26 17:03:10 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 17:03:10 user nova-compute[75113]:         </nova:port>
Oct 26 17:03:10 user nova-compute[75113]:       </nova:ports>
Oct 26 17:03:10 user nova-compute[75113]:     </nova:instance>
Oct 26 17:03:10 user nova-compute[75113]:   </metadata>
Oct 26 17:03:10 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:03:10 user nova-compute[75113]:     <system>
Oct 26 17:03:10 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:03:10 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:03:10 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:03:10 user nova-compute[75113]:       <entry name="serial">5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88</entry>
Oct 26 17:03:10 user nova-compute[75113]:       <entry name="uuid">5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88</entry>
Oct 26 17:03:10 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:03:10 user nova-compute[75113]:     </system>
Oct 26 17:03:10 user nova-compute[75113]:   </sysinfo>
Oct 26 17:03:10 user nova-compute[75113]:   <os>
Oct 26 17:03:10 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:03:10 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:03:10 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:03:10 user nova-compute[75113]:   </os>
Oct 26 17:03:10 user nova-compute[75113]:   <features>
Oct 26 17:03:10 user nova-compute[75113]:     <acpi/>
Oct 26 17:03:10 user nova-compute[75113]:     <apic/>
Oct 26 17:03:10 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:03:10 user nova-compute[75113]:   </features>
Oct 26 17:03:10 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:03:10 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:03:10 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:03:10 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:03:10 user nova-compute[75113]:   </clock>
Oct 26 17:03:10 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:03:10 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:03:10 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:03:10 user nova-compute[75113]:   </cpu>
Oct 26 17:03:10 user nova-compute[75113]:   <devices>
Oct 26 17:03:10 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:03:10 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:03:10 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk"/>
Oct 26 17:03:10 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:03:10 user nova-compute[75113]:     </disk>
Oct 26 17:03:10 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:03:10 user nova-compute[75113]:       <mac address="fa:16:3e:00:a6:36"/>
Oct 26 17:03:10 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:03:10 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:03:10 user nova-compute[75113]:       <target dev="tap03fed87a-c8"/>
Oct 26 17:03:10 user nova-compute[75113]:     </interface>
Oct 26 17:03:10 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:03:10 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/console.log" append="off"/>
Oct 26 17:03:10 user nova-compute[75113]:     </serial>
Oct 26 17:03:10 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:03:10 user nova-compute[75113]:     <video>
Oct 26 17:03:10 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:03:10 user nova-compute[75113]:     </video>
Oct 26 17:03:10 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:03:10 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:03:10 user nova-compute[75113]:     </rng>
Oct 26 17:03:10 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:03:10 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:03:10 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:03:10 user nova-compute[75113]:     </memballoon>
Oct 26 17:03:10 user nova-compute[75113]:   </devices>
Oct 26 17:03:10 user nova-compute[75113]: </domain>
Oct 26 17:03:10 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1323343316',display_name='tempest-ServerRescueNegativeTestJSON-server-1323343316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1323343316',id=24,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d11c5d88b2f4a45acee2e9c7d26043a',ramdisk_id='',reservation_id='r-oxsm407w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760587308',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760587308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:03:07Z,user_data=None,user_id='5aa8e21aab014ce6ace0109878275b8f',uuid=5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converting VIF {"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=03fed87a-c881-4ca6-85a3-4440a97ddd8c,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fed87a-c8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG os_vif [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=03fed87a-c881-4ca6-85a3-4440a97ddd8c,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fed87a-c8') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:03:10 user nova-compute[75113]: INFO nova.compute.manager [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Took 8.59 seconds to spawn the instance on the hypervisor.
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'adc76d13-bda5-589b-aafd-3382e164bbe6', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received event network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] No waiting events found dispatching network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:03:10 user nova-compute[75113]: WARNING nova.compute.manager [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received unexpected event network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf for instance with vm_state building and task_state spawning.
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Received event network-vif-plugged-5ccc0af1-e477-4bc0-914b-7229f64a9c0b {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] Acquiring lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] No waiting events found dispatching network-vif-plugged-5ccc0af1-e477-4bc0-914b-7229f64a9c0b {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:03:10 user nova-compute[75113]: WARNING nova.compute.manager [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Received unexpected event network-vif-plugged-5ccc0af1-e477-4bc0-914b-7229f64a9c0b for instance with vm_state building and task_state spawning.
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Received event network-vif-plugged-5ccc0af1-e477-4bc0-914b-7229f64a9c0b {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] Acquiring lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] No waiting events found dispatching network-vif-plugged-5ccc0af1-e477-4bc0-914b-7229f64a9c0b {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:03:10 user nova-compute[75113]: WARNING nova.compute.manager [req-94d5b765-efea-4f9f-8d29-f321cce3d56a req-b45e1349-1b3b-4ab9-925e-b78c198cbdb1 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Received unexpected event network-vif-plugged-5ccc0af1-e477-4bc0-914b-7229f64a9c0b for instance with vm_state building and task_state spawning.
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03fed87a-c8, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03fed87a-c8, col_values=(('qos', UUID('ea956851-3f33-4071-b529-3e8b0833e359')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03fed87a-c8, col_values=(('external_ids', {'iface-id': '03fed87a-c881-4ca6-85a3-4440a97ddd8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:a6:36', 'vm-uuid': '5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:10 user nova-compute[75113]: INFO os_vif [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=03fed87a-c881-4ca6-85a3-4440a97ddd8c,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fed87a-c8')
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:10 user nova-compute[75113]: INFO nova.compute.manager [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Took 10.07 seconds to build instance.
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No VIF found with MAC fa:16:3e:00:a6:36, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5f6a32aa-f429-42c2-8938-bde104194d89 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.270s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:10 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Instance spawned successfully.
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:10 user nova-compute[75113]: INFO nova.compute.manager [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Took 8.16 seconds to spawn the instance on the hypervisor.
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.network.neutron [req-f08df503-d397-484e-a7c3-cc992a7b9143 req-1ed2b039-a08a-4296-9857-162e5f676343 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Updated VIF entry in instance network info cache for port 03fed87a-c881-4ca6-85a3-4440a97ddd8c. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG nova.network.neutron [req-f08df503-d397-484e-a7c3-cc992a7b9143 req-1ed2b039-a08a-4296-9857-162e5f676343 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Updating instance_info_cache with network_info: [{"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f08df503-d397-484e-a7c3-cc992a7b9143 req-1ed2b039-a08a-4296-9857-162e5f676343 service nova] Releasing lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:03:10 user nova-compute[75113]: INFO nova.compute.manager [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Took 10.65 seconds to build instance.
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7b74aa4d-85c3-4867-ae39-e703d518d520 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.848s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG nova.compute.manager [req-449e1675-b565-4536-9146-cb75e1da9f09 req-b1738c14-ff72-4308-95d2-9386b27e84d5 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-449e1675-b565-4536-9146-cb75e1da9f09 req-b1738c14-ff72-4308-95d2-9386b27e84d5 service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-449e1675-b565-4536-9146-cb75e1da9f09 req-b1738c14-ff72-4308-95d2-9386b27e84d5 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-449e1675-b565-4536-9146-cb75e1da9f09 req-b1738c14-ff72-4308-95d2-9386b27e84d5 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG nova.compute.manager [req-449e1675-b565-4536-9146-cb75e1da9f09 req-b1738c14-ff72-4308-95d2-9386b27e84d5 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:03:11 user nova-compute[75113]: WARNING nova.compute.manager [req-449e1675-b565-4536-9146-cb75e1da9f09 req-b1738c14-ff72-4308-95d2-9386b27e84d5 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state building and task_state spawning.
Oct 26 17:03:11 user nova-compute[75113]: DEBUG nova.compute.manager [req-449e1675-b565-4536-9146-cb75e1da9f09 req-b1738c14-ff72-4308-95d2-9386b27e84d5 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-449e1675-b565-4536-9146-cb75e1da9f09 req-b1738c14-ff72-4308-95d2-9386b27e84d5 service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-449e1675-b565-4536-9146-cb75e1da9f09 req-b1738c14-ff72-4308-95d2-9386b27e84d5 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-449e1675-b565-4536-9146-cb75e1da9f09 req-b1738c14-ff72-4308-95d2-9386b27e84d5 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG nova.compute.manager [req-449e1675-b565-4536-9146-cb75e1da9f09 req-b1738c14-ff72-4308-95d2-9386b27e84d5 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:03:11 user nova-compute[75113]: WARNING nova.compute.manager [req-449e1675-b565-4536-9146-cb75e1da9f09 req-b1738c14-ff72-4308-95d2-9386b27e84d5 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state building and task_state spawning.
Oct 26 17:03:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:03:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:15 user nova-compute[75113]: DEBUG nova.compute.manager [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:03:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:03:15 user nova-compute[75113]: DEBUG nova.compute.manager [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:03:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:03:15 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Instance spawned successfully.
Oct 26 17:03:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:03:15 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:03:15 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:03:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7570MB free_disk=25.30913543701172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:03:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:15 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Instance spawned successfully.
Oct 26 17:03:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:03:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:03:16 user nova-compute[75113]: INFO nova.compute.manager [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Took 9.78 seconds to spawn the instance on the hypervisor.
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:03:16 user nova-compute[75113]: INFO nova.compute.manager [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Took 8.78 seconds to spawn the instance on the hypervisor.
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 645deae0-4c03-41d0-aa3b-daa79ed25425 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 76039e5a-db02-48b4-81eb-a7383d1374b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance a2bbd45c-c153-408c-ba58-2f161963989e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:03:16 user nova-compute[75113]: INFO nova.compute.manager [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Took 11.21 seconds to build instance.
Oct 26 17:03:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0413cf99-4b40-4a92-ab46-f11df2dd2251 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.377s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:16 user nova-compute[75113]: INFO nova.compute.manager [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Took 10.22 seconds to build instance.
Oct 26 17:03:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d96d0e26-3152-4e4f-88b6-3b93830c2fa2 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.351s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:03:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.782s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-2d05f8df-3668-481a-929d-4903fb9a6fb8 req-80a4bba8-0f30-46f4-8e4b-678e6455e43f service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2d05f8df-3668-481a-929d-4903fb9a6fb8 req-80a4bba8-0f30-46f4-8e4b-678e6455e43f service nova] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2d05f8df-3668-481a-929d-4903fb9a6fb8 req-80a4bba8-0f30-46f4-8e4b-678e6455e43f service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2d05f8df-3668-481a-929d-4903fb9a6fb8 req-80a4bba8-0f30-46f4-8e4b-678e6455e43f service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-2d05f8df-3668-481a-929d-4903fb9a6fb8 req-80a4bba8-0f30-46f4-8e4b-678e6455e43f service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] No waiting events found dispatching network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:03:18 user nova-compute[75113]: WARNING nova.compute.manager [req-2d05f8df-3668-481a-929d-4903fb9a6fb8 req-80a4bba8-0f30-46f4-8e4b-678e6455e43f service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received unexpected event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c for instance with vm_state active and task_state None.
Oct 26 17:03:18 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:18 user nova-compute[75113]: INFO nova.compute.manager [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Terminating instance
Oct 26 17:03:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-a22761c7-2195-4c6f-b73c-ead3bdadf87d req-1898374e-da44-41c9-a3d6-27ca4652ee9a service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-unplugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a22761c7-2195-4c6f-b73c-ead3bdadf87d req-1898374e-da44-41c9-a3d6-27ca4652ee9a service nova] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a22761c7-2195-4c6f-b73c-ead3bdadf87d req-1898374e-da44-41c9-a3d6-27ca4652ee9a service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a22761c7-2195-4c6f-b73c-ead3bdadf87d req-1898374e-da44-41c9-a3d6-27ca4652ee9a service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-a22761c7-2195-4c6f-b73c-ead3bdadf87d req-1898374e-da44-41c9-a3d6-27ca4652ee9a service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] No waiting events found dispatching network-vif-unplugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-a22761c7-2195-4c6f-b73c-ead3bdadf87d req-1898374e-da44-41c9-a3d6-27ca4652ee9a service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-unplugged-96d708f7-00f7-44af-9bc6-43882921ea03 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:03:19 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Instance destroyed successfully.
Oct 26 17:03:19 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lazy-loading 'resources' on Instance uuid 645deae0-4c03-41d0-aa3b-daa79ed25425 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1163194343',display_name='tempest-ServerActionsTestOtherB-server-1163194343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1163194343',id=2,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNi6S0kdc5pWvhxq2azP5QRonb6qXMUiteND1nfP3Uf2jZWYfGzWg8fbqOsk4PAj062T9NqyLIEevO2i2GpMs0q5myp5A+SX7ogwodc86c3yyzOTm1sjFsenkun5EW0fg==',key_name='tempest-keypair-1305775717',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:01:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='992a6be3e5814c3b80c705763af5de1e',ramdisk_id='',reservation_id='r-fvz5sf1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1008157220',owner_user_name='tempest-ServerActionsTestOtherB-1008157220-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f45ddba3b44d1b9333b282e43b02e8',uuid=645deae0-4c03-41d0-aa3b-daa79ed25425,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converting VIF {"id": "96d708f7-00f7-44af-9bc6-43882921ea03", "address": "fa:16:3e:0e:ed:4e", "network": {"id": "82c4c43d-fb28-49cf-8639-9ea16756fe40", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-918986316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "992a6be3e5814c3b80c705763af5de1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d708f7-00", "ovs_interfaceid": "96d708f7-00f7-44af-9bc6-43882921ea03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG os_vif [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96d708f7-00, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf51f854-c129-403f-9c75-8c5034a5630e) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:19 user nova-compute[75113]: INFO os_vif [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:4e,bridge_name='br-int',has_traffic_filtering=True,id=96d708f7-00f7-44af-9bc6-43882921ea03,network=Network(82c4c43d-fb28-49cf-8639-9ea16756fe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d708f7-00')
Oct 26 17:03:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAOpQCYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:03:19 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:03:19 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8080a90-9f2e-475a-87a4-2977bc8e3aed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:03:19 user nova-compute[75113]: No targets found.
Oct 26 17:03:19 user nova-compute[75113]: iSNS:
Oct 26 17:03:19 user nova-compute[75113]: No targets found.
Oct 26 17:03:19 user nova-compute[75113]: STATIC:
Oct 26 17:03:19 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4
Oct 26 17:03:19 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:03:19 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:03:19 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b
Oct 26 17:03:19 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:03:19 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:03:19 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597
Oct 26 17:03:19 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:03:19 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:03:19 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:03:19 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:03:19 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:03:19 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620
Oct 26 17:03:19 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:03:19 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:03:19 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad
Oct 26 17:03:19 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:03:19 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:03:19 user nova-compute[75113]: FIRMWARE:
Oct 26 17:03:19 user nova-compute[75113]: No targets found.
Oct 26 17:03:19 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:03:19 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:03:19 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.039s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9851f910-374c-46ac-b9aa-a7561c27c8f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[71001216-0461-41ba-b574-1027fbeedd57]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:03:19 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:03:19 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:03:19 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:03:19 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:03:19 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:03:19 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad (non-flash)
Oct 26 17:03:19 user nova-compute[75113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:03:19 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:03:19 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:03:19 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:03:19 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:03:19 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49143da8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff6439b-a987-401e-841a-5aee3d30eb1b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0491cd-3565-4e9c-b9bb-d7427d961f25]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3dd78e-ff1d-4995-b0da-3530b807edd2]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:03:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fe484a-189d-41e8-9545-29a1a91a37fe]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1c8494-e291-44a0-80d5-0483bf35a069]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2991f86d-b492-4f5e-9e51-7a0e0a2a8854]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260]
Oct 26 17:03:20 user nova-compute[75113]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad, portal: 172.16.0.220,3260] successful.
Oct 26 17:03:20 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2af05ff-ba68-4321-b9b9-b5cf9a720bad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c8012c-35be-4d87-8b76-147f3bd94a59]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] <== disconnect_volume: return (411ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:03:20 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Deleting instance files /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425_del
Oct 26 17:03:20 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Deletion of /opt/stack/data/nova/instances/645deae0-4c03-41d0-aa3b-daa79ed25425_del complete
Oct 26 17:03:20 user nova-compute[75113]: INFO nova.compute.manager [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Took 1.48 seconds to destroy the instance on the hypervisor.
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-6e743374-02bc-4a13-9843-ccfc60da322e req-4169f6d5-c2be-4f42-9c23-feaa864bb31c service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6e743374-02bc-4a13-9843-ccfc60da322e req-4169f6d5-c2be-4f42-9c23-feaa864bb31c service nova] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6e743374-02bc-4a13-9843-ccfc60da322e req-4169f6d5-c2be-4f42-9c23-feaa864bb31c service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6e743374-02bc-4a13-9843-ccfc60da322e req-4169f6d5-c2be-4f42-9c23-feaa864bb31c service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-6e743374-02bc-4a13-9843-ccfc60da322e req-4169f6d5-c2be-4f42-9c23-feaa864bb31c service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] No waiting events found dispatching network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:03:20 user nova-compute[75113]: WARNING nova.compute.manager [req-6e743374-02bc-4a13-9843-ccfc60da322e req-4169f6d5-c2be-4f42-9c23-feaa864bb31c service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received unexpected event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c for instance with vm_state active and task_state None.
Oct 26 17:03:21 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:21 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Took 1.03 seconds to deallocate network for instance.
Oct 26 17:03:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-2fa8e7d1-5f8d-4bb0-bff3-123e391c5df1 req-eb45f3af-0288-4458-a612-83fb99f15fde service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2fa8e7d1-5f8d-4bb0-bff3-123e391c5df1 req-eb45f3af-0288-4458-a612-83fb99f15fde service nova] Acquiring lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2fa8e7d1-5f8d-4bb0-bff3-123e391c5df1 req-eb45f3af-0288-4458-a612-83fb99f15fde service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2fa8e7d1-5f8d-4bb0-bff3-123e391c5df1 req-eb45f3af-0288-4458-a612-83fb99f15fde service nova] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-2fa8e7d1-5f8d-4bb0-bff3-123e391c5df1 req-eb45f3af-0288-4458-a612-83fb99f15fde service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] No waiting events found dispatching network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:03:21 user nova-compute[75113]: WARNING nova.compute.manager [req-2fa8e7d1-5f8d-4bb0-bff3-123e391c5df1 req-eb45f3af-0288-4458-a612-83fb99f15fde service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received unexpected event network-vif-plugged-96d708f7-00f7-44af-9bc6-43882921ea03 for instance with vm_state active and task_state deleting.
Oct 26 17:03:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-2fa8e7d1-5f8d-4bb0-bff3-123e391c5df1 req-eb45f3af-0288-4458-a612-83fb99f15fde service nova] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Received event network-vif-deleted-96d708f7-00f7-44af-9bc6-43882921ea03 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:22 user nova-compute[75113]: INFO nova.compute.manager [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] [instance: 645deae0-4c03-41d0-aa3b-daa79ed25425] Took 1.07 seconds to detach 1 volumes for instance.
Oct 26 17:03:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:22 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:03:22 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:03:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.570s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:23 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Deleted allocations for instance 645deae0-4c03-41d0-aa3b-daa79ed25425
Oct 26 17:03:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a8316501-c3de-4409-b850-dc99b3a910b4 tempest-ServerActionsTestOtherB-1008157220 tempest-ServerActionsTestOtherB-1008157220-project-member] Lock "645deae0-4c03-41d0-aa3b-daa79ed25425" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.432s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "37683519-d90a-4fa4-8e8f-cc883a2573ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:32 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:03:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:32 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:03:32 user nova-compute[75113]: INFO nova.compute.claims [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Claim successful on node user
Oct 26 17:03:33 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG nova.network.neutron [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:03:33 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:03:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG nova.policy [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9de31526e7d049c0933bd981347ad67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e3ef36922d4fb7902344a5e66d9941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:03:33 user nova-compute[75113]: INFO nova.virt.block_device [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Booting with volume c2de619a-4ee3-47dd-8780-dd158767fe24 at /dev/vda
Oct 26 17:03:33 user nova-compute[75113]: DEBUG os_brick.utils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1ac9c8-7fe1-416a-af78-15a652b4a605]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[55726952-d051-4f6a-b470-5f09647c30bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ed1db6-3cd1-42e8-81ec-9a35997aad76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4584e4-24fa-410e-85be-c7ba4e8db563]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:03:33 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:03:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f087e2-435b-4596-8ab9-d39e730be2a1]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG os_brick.utils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Updating existing volume attachment record: 9d7d33d8-fb99-46f9-9546-0c6d1d76e9ee {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:03:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:34 user nova-compute[75113]: DEBUG nova.network.neutron [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Successfully created port: d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:03:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:34 user nova-compute[75113]: DEBUG nova.network.neutron [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Successfully updated port: d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:03:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "refresh_cache-37683519-d90a-4fa4-8e8f-cc883a2573ac" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:03:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquired lock "refresh_cache-37683519-d90a-4fa4-8e8f-cc883a2573ac" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:03:34 user nova-compute[75113]: DEBUG nova.network.neutron [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:03:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-dd5ab206-21dd-49e6-84be-d72703204d44 req-b1208af6-c013-427f-b10c-29e87986b526 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received event network-changed-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-dd5ab206-21dd-49e6-84be-d72703204d44 req-b1208af6-c013-427f-b10c-29e87986b526 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Refreshing instance network info cache due to event network-changed-d7e20a2e-c0b5-4551-bc13-e3ef233eae81. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:03:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dd5ab206-21dd-49e6-84be-d72703204d44 req-b1208af6-c013-427f-b10c-29e87986b526 service nova] Acquiring lock "refresh_cache-37683519-d90a-4fa4-8e8f-cc883a2573ac" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:03:34 user nova-compute[75113]: DEBUG nova.network.neutron [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:03:35 user nova-compute[75113]: DEBUG nova.network.neutron [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Updating instance_info_cache with network_info: [{"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Releasing lock "refresh_cache-37683519-d90a-4fa4-8e8f-cc883a2573ac" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:03:35 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Instance network_info: |[{"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:03:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dd5ab206-21dd-49e6-84be-d72703204d44 req-b1208af6-c013-427f-b10c-29e87986b526 service nova] Acquired lock "refresh_cache-37683519-d90a-4fa4-8e8f-cc883a2573ac" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:03:35 user nova-compute[75113]: DEBUG nova.network.neutron [req-dd5ab206-21dd-49e6-84be-d72703204d44 req-b1208af6-c013-427f-b10c-29e87986b526 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Refreshing network info cache for port d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:03:35 user nova-compute[75113]: DEBUG nova.network.neutron [req-dd5ab206-21dd-49e6-84be-d72703204d44 req-b1208af6-c013-427f-b10c-29e87986b526 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Updated VIF entry in instance network info cache for port d7e20a2e-c0b5-4551-bc13-e3ef233eae81. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:03:35 user nova-compute[75113]: DEBUG nova.network.neutron [req-dd5ab206-21dd-49e6-84be-d72703204d44 req-b1208af6-c013-427f-b10c-29e87986b526 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Updating instance_info_cache with network_info: [{"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dd5ab206-21dd-49e6-84be-d72703204d44 req-b1208af6-c013-427f-b10c-29e87986b526 service nova] Releasing lock "refresh_cache-37683519-d90a-4fa4-8e8f-cc883a2573ac" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:03:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:03:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-75bdf4ad-f919-4cfc-bdde-548e6671af51 req-c3ab56c9-5e6f-4cfd-ad5a-dae06550f0e5 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-changed-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-75bdf4ad-f919-4cfc-bdde-548e6671af51 req-c3ab56c9-5e6f-4cfd-ad5a-dae06550f0e5 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Refreshing instance network info cache due to event network-changed-ff980165-116a-431e-90a0-3a1d98b79b9d. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:03:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-75bdf4ad-f919-4cfc-bdde-548e6671af51 req-c3ab56c9-5e6f-4cfd-ad5a-dae06550f0e5 service nova] Acquiring lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:03:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-75bdf4ad-f919-4cfc-bdde-548e6671af51 req-c3ab56c9-5e6f-4cfd-ad5a-dae06550f0e5 service nova] Acquired lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:03:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-75bdf4ad-f919-4cfc-bdde-548e6671af51 req-c3ab56c9-5e6f-4cfd-ad5a-dae06550f0e5 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Refreshing network info cache for port ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:03:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-75bdf4ad-f919-4cfc-bdde-548e6671af51 req-c3ab56c9-5e6f-4cfd-ad5a-dae06550f0e5 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updated VIF entry in instance network info cache for port ff980165-116a-431e-90a0-3a1d98b79b9d. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:03:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-75bdf4ad-f919-4cfc-bdde-548e6671af51 req-c3ab56c9-5e6f-4cfd-ad5a-dae06550f0e5 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updating instance_info_cache with network_info: [{"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-75bdf4ad-f919-4cfc-bdde-548e6671af51 req-c3ab56c9-5e6f-4cfd-ad5a-dae06550f0e5 service nova] Releasing lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-129c7ffa-c3dd-465d-8cdf-a73919308d08 req-bd165e52-edc8-4eb4-82fc-c8c7a9fe0795 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-changed-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-129c7ffa-c3dd-465d-8cdf-a73919308d08 req-bd165e52-edc8-4eb4-82fc-c8c7a9fe0795 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Refreshing instance network info cache due to event network-changed-ff980165-116a-431e-90a0-3a1d98b79b9d. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-129c7ffa-c3dd-465d-8cdf-a73919308d08 req-bd165e52-edc8-4eb4-82fc-c8c7a9fe0795 service nova] Acquiring lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-129c7ffa-c3dd-465d-8cdf-a73919308d08 req-bd165e52-edc8-4eb4-82fc-c8c7a9fe0795 service nova] Acquired lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.network.neutron [req-129c7ffa-c3dd-465d-8cdf-a73919308d08 req-bd165e52-edc8-4eb4-82fc-c8c7a9fe0795 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Refreshing network info cache for port ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:03:59 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Creating image(s)
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Ensure instance console log exists: /opt/stack/data/nova/instances/37683519-d90a-4fa4-8e8f-cc883a2573ac/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Start _get_guest_xml network_info=[{"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9d7d33d8-fb99-46f9-9546-0c6d1d76e9ee', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNKpJYag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '37683519-d90a-4fa4-8e8f-cc883a2573ac', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2de619a-4ee3-47dd-8780-dd158767fe24', 'serial': 'c2de619a-4ee3-47dd-8780-dd158767fe24'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:03:59 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:03:59 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNKpJYag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:03:59 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:03:59 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:03:59 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4105f1f-76f2-4a0a-9157-ce8784d9fca3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:03:59 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b521a9-81cb-4121-9ab8-b4084f610602]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24] added
Oct 26 17:03:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a58b620-225b-4434-a855-1c2a1966a059]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a21372d-72db-4111-bd3d-ba1e3d9ad21a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNKpJYag {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:59 user nova-compute[75113]: INFO nova.compute.manager [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Detaching volume c0274fd0-61fa-4d16-a99a-c91310ce3597
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNKpJYag" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99bfd27-3e59-410e-8cf8-85702848a184]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BNKpJYag'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edaffa6-8c20-4275-848b-08b19825a59f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffa873d-3222-4133-a3d6-9b389c28a749]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:59 user nova-compute[75113]: INFO nova.virt.block_device [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Attempting to driver detach volume c0274fd0-61fa-4d16-a99a-c91310ce3597 from mountpoint /dev/vdb
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Attempting to detach device vdb from instance 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:03:59 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:03:59 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:03:59 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:03:59 user nova-compute[75113]:   <serial>c0274fd0-61fa-4d16-a99a-c91310ce3597</serial>
Oct 26 17:03:59 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 17:03:59 user nova-compute[75113]: </disk>
Oct 26 17:03:59 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:03:59 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Successfully detached device vdb from instance 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 from the persistent domain config.
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:03:59 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:03:59 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:03:59 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:03:59 user nova-compute[75113]:   <serial>c0274fd0-61fa-4d16-a99a-c91310ce3597</serial>
Oct 26 17:03:59 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 17:03:59 user nova-compute[75113]: </disk>
Oct 26 17:03:59 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c63deed-832f-439c-9aeb-14d3f4acd5c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260]
Oct 26 17:03:59 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260] successful.
Oct 26 17:03:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14c5e1e-e919-43c2-af96-4d6d2af3b846]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.network.neutron [req-129c7ffa-c3dd-465d-8cdf-a73919308d08 req-bd165e52-edc8-4eb4-82fc-c8c7a9fe0795 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updated VIF entry in instance network info cache for port ff980165-116a-431e-90a0-3a1d98b79b9d. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG nova.network.neutron [req-129c7ffa-c3dd-465d-8cdf-a73919308d08 req-bd165e52-edc8-4eb4-82fc-c8c7a9fe0795 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updating instance_info_cache with network_info: [{"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ec5855-3c5f-4fb8-aefd-1b71fe8cf4f6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:03:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-129c7ffa-c3dd-465d-8cdf-a73919308d08 req-bd165e52-edc8-4eb4-82fc-c8c7a9fe0795 service nova] Releasing lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[17623ff5-8880-44a1-8d1d-c44616c45c3f]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:03:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:04:00 user nova-compute[75113]: INFO nova.compute.manager [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Rescuing
Oct 26 17:04:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquired lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNKpJYag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23739353231663262', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739353231663262', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1698414037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1698414037',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdPVR8jrmmvs+FA1zsu8BhsOGQFKaF3g3dbAYbTOUQUphGdHDb5ZBl+LTAW9kwLngnlZjZt/Fup1ZMGDest0Syvi7iB20PUTksvIR3dTjbbM0POZ2eFVo0aHjgMG+Kq4A==',key_name='tempest-keypair-352373129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71e3ef36922d4fb7902344a5e66d9941',ramdisk_id='',reservation_id='r-vdp0td0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1360395865',owner_user_name='tempest-ServerActionsV293TestJSON-1360395865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:03:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9de31526e7d049c0933bd981347ad67b',uuid=37683519-d90a-4fa4-8e8f-cc883a2573ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Converting VIF {"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG nova.objects.instance [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lazy-loading 'pci_devices' on Instance uuid 37683519-d90a-4fa4-8e8f-cc883a2573ac {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:04:00 user nova-compute[75113]:   <uuid>37683519-d90a-4fa4-8e8f-cc883a2573ac</uuid>
Oct 26 17:04:00 user nova-compute[75113]:   <name>instance-00000019</name>
Oct 26 17:04:00 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:04:00 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:04:00 user nova-compute[75113]:   <metadata>
Oct 26 17:04:00 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:04:00 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:04:00 user nova-compute[75113]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1698414037</nova:name>
Oct 26 17:04:00 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:03:59</nova:creationTime>
Oct 26 17:04:00 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:04:00 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:04:00 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:04:00 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:04:00 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:04:00 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:04:00 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:04:00 user nova-compute[75113]:       <nova:owner>
Oct 26 17:04:00 user nova-compute[75113]:         <nova:user uuid="9de31526e7d049c0933bd981347ad67b">tempest-ServerActionsV293TestJSON-1360395865-project-member</nova:user>
Oct 26 17:04:00 user nova-compute[75113]:         <nova:project uuid="71e3ef36922d4fb7902344a5e66d9941">tempest-ServerActionsV293TestJSON-1360395865</nova:project>
Oct 26 17:04:00 user nova-compute[75113]:       </nova:owner>
Oct 26 17:04:00 user nova-compute[75113]:       <nova:ports>
Oct 26 17:04:00 user nova-compute[75113]:         <nova:port uuid="d7e20a2e-c0b5-4551-bc13-e3ef233eae81">
Oct 26 17:04:00 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 17:04:00 user nova-compute[75113]:         </nova:port>
Oct 26 17:04:00 user nova-compute[75113]:       </nova:ports>
Oct 26 17:04:00 user nova-compute[75113]:     </nova:instance>
Oct 26 17:04:00 user nova-compute[75113]:   </metadata>
Oct 26 17:04:00 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:04:00 user nova-compute[75113]:     <system>
Oct 26 17:04:00 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:04:00 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:04:00 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:04:00 user nova-compute[75113]:       <entry name="serial">37683519-d90a-4fa4-8e8f-cc883a2573ac</entry>
Oct 26 17:04:00 user nova-compute[75113]:       <entry name="uuid">37683519-d90a-4fa4-8e8f-cc883a2573ac</entry>
Oct 26 17:04:00 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:04:00 user nova-compute[75113]:     </system>
Oct 26 17:04:00 user nova-compute[75113]:   </sysinfo>
Oct 26 17:04:00 user nova-compute[75113]:   <os>
Oct 26 17:04:00 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:04:00 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:04:00 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:04:00 user nova-compute[75113]:   </os>
Oct 26 17:04:00 user nova-compute[75113]:   <features>
Oct 26 17:04:00 user nova-compute[75113]:     <acpi/>
Oct 26 17:04:00 user nova-compute[75113]:     <apic/>
Oct 26 17:04:00 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:04:00 user nova-compute[75113]:   </features>
Oct 26 17:04:00 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:04:00 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:04:00 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:04:00 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:04:00 user nova-compute[75113]:   </clock>
Oct 26 17:04:00 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:04:00 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:04:00 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:04:00 user nova-compute[75113]:   </cpu>
Oct 26 17:04:00 user nova-compute[75113]:   <devices>
Oct 26 17:04:00 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:04:00 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:04:00 user nova-compute[75113]:       <source dev="/dev/sdb"/>
Oct 26 17:04:00 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:04:00 user nova-compute[75113]:       <serial>c2de619a-4ee3-47dd-8780-dd158767fe24</serial>
Oct 26 17:04:00 user nova-compute[75113]:     </disk>
Oct 26 17:04:00 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:04:00 user nova-compute[75113]:       <mac address="fa:16:3e:a2:c2:3a"/>
Oct 26 17:04:00 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:04:00 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:04:00 user nova-compute[75113]:       <target dev="tapd7e20a2e-c0"/>
Oct 26 17:04:00 user nova-compute[75113]:     </interface>
Oct 26 17:04:00 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:04:00 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/37683519-d90a-4fa4-8e8f-cc883a2573ac/console.log" append="off"/>
Oct 26 17:04:00 user nova-compute[75113]:     </serial>
Oct 26 17:04:00 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:04:00 user nova-compute[75113]:     <video>
Oct 26 17:04:00 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:04:00 user nova-compute[75113]:     </video>
Oct 26 17:04:00 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:04:00 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:04:00 user nova-compute[75113]:     </rng>
Oct 26 17:04:00 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:04:00 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:04:00 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:04:00 user nova-compute[75113]:     </memballoon>
Oct 26 17:04:00 user nova-compute[75113]:   </devices>
Oct 26 17:04:00 user nova-compute[75113]: </domain>
Oct 26 17:04:00 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1698414037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1698414037',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdPVR8jrmmvs+FA1zsu8BhsOGQFKaF3g3dbAYbTOUQUphGdHDb5ZBl+LTAW9kwLngnlZjZt/Fup1ZMGDest0Syvi7iB20PUTksvIR3dTjbbM0POZ2eFVo0aHjgMG+Kq4A==',key_name='tempest-keypair-352373129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71e3ef36922d4fb7902344a5e66d9941',ramdisk_id='',reservation_id='r-vdp0td0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1360395865',owner_user_name='tempest-ServerActionsV293TestJSON-1360395865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:03:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9de31526e7d049c0933bd981347ad67b',uuid=37683519-d90a-4fa4-8e8f-cc883a2573ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Converting VIF {"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG os_vif [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1931371-6aff-53e9-8da4-a1672e50d866', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7e20a2e-c0, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7e20a2e-c0, col_values=(('qos', UUID('e6186074-5b0a-4410-9abe-4165124bc10d')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7e20a2e-c0, col_values=(('external_ids', {'iface-id': 'd7e20a2e-c0b5-4551-bc13-e3ef233eae81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:c2:3a', 'vm-uuid': '37683519-d90a-4fa4-8e8f-cc883a2573ac'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:00 user nova-compute[75113]: INFO os_vif [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0')
Oct 26 17:04:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:04:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] No VIF found with MAC fa:16:3e:a2:c2:3a, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Updating instance_info_cache with network_info: [{"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Releasing lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-4aca8c2f-45db-47e1-9be4-33241813ad41 req-6f17c454-c2e1-45a3-84d3-a4ceb8418c57 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-unplugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4aca8c2f-45db-47e1-9be4-33241813ad41 req-6f17c454-c2e1-45a3-84d3-a4ceb8418c57 service nova] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4aca8c2f-45db-47e1-9be4-33241813ad41 req-6f17c454-c2e1-45a3-84d3-a4ceb8418c57 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4aca8c2f-45db-47e1-9be4-33241813ad41 req-6f17c454-c2e1-45a3-84d3-a4ceb8418c57 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-4aca8c2f-45db-47e1-9be4-33241813ad41 req-6f17c454-c2e1-45a3-84d3-a4ceb8418c57 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] No waiting events found dispatching network-vif-unplugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:01 user nova-compute[75113]: WARNING nova.compute.manager [req-4aca8c2f-45db-47e1-9be4-33241813ad41 req-6f17c454-c2e1-45a3-84d3-a4ceb8418c57 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received unexpected event network-vif-unplugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 for instance with vm_state active and task_state rescuing.
Oct 26 17:04:02 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updating instance_info_cache with network_info: [{"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:04:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:04:02 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:04:02 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:04:02 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Instance destroyed successfully.
Oct 26 17:04:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:02 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Attempting a stable device rescue
Oct 26 17:04:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:02 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75113) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 17:04:02 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Instance directory exists: not creating {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 17:04:02 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Creating image(s)
Oct 26 17:04:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "/opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "/opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "/opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:02 user nova-compute[75113]: DEBUG nova.objects.instance [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "3baba9d84997e932b5bfa3b5e339f764edec0550" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "3baba9d84997e932b5bfa3b5e339f764edec0550" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3baba9d84997e932b5bfa3b5e339f764edec0550.part --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:04:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-c38d65cd-af4e-4f6e-a102-6b575634857f req-b33545e0-b772-4d67-87c2-36ba13dafd52 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received event network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c38d65cd-af4e-4f6e-a102-6b575634857f req-b33545e0-b772-4d67-87c2-36ba13dafd52 service nova] Acquiring lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c38d65cd-af4e-4f6e-a102-6b575634857f req-b33545e0-b772-4d67-87c2-36ba13dafd52 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c38d65cd-af4e-4f6e-a102-6b575634857f req-b33545e0-b772-4d67-87c2-36ba13dafd52 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-c38d65cd-af4e-4f6e-a102-6b575634857f req-b33545e0-b772-4d67-87c2-36ba13dafd52 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] No waiting events found dispatching network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:03 user nova-compute[75113]: WARNING nova.compute.manager [req-c38d65cd-af4e-4f6e-a102-6b575634857f req-b33545e0-b772-4d67-87c2-36ba13dafd52 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received unexpected event network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 for instance with vm_state building and task_state spawning.
Oct 26 17:04:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3baba9d84997e932b5bfa3b5e339f764edec0550.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:03 user nova-compute[75113]: DEBUG nova.virt.images [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] bd8ee885-77da-41bf-86e6-e63ae11fb058 was qcow2, converting to raw {{(pid=75113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 17:04:03 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 17:04:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3baba9d84997e932b5bfa3b5e339f764edec0550.part /opt/stack/data/nova/instances/_base/3baba9d84997e932b5bfa3b5e339f764edec0550.converted {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-c6bfea2a-6154-4353-9462-327cc589c696 req-4d0524e2-1c7e-414a-b661-48db52ec2c4d service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c6bfea2a-6154-4353-9462-327cc589c696 req-4d0524e2-1c7e-414a-b661-48db52ec2c4d service nova] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c6bfea2a-6154-4353-9462-327cc589c696 req-4d0524e2-1c7e-414a-b661-48db52ec2c4d service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c6bfea2a-6154-4353-9462-327cc589c696 req-4d0524e2-1c7e-414a-b661-48db52ec2c4d service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-c6bfea2a-6154-4353-9462-327cc589c696 req-4d0524e2-1c7e-414a-b661-48db52ec2c4d service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] No waiting events found dispatching network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:04 user nova-compute[75113]: WARNING nova.compute.manager [req-c6bfea2a-6154-4353-9462-327cc589c696 req-4d0524e2-1c7e-414a-b661-48db52ec2c4d service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received unexpected event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 for instance with vm_state active and task_state rescuing.
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3baba9d84997e932b5bfa3b5e339f764edec0550.part /opt/stack/data/nova/instances/_base/3baba9d84997e932b5bfa3b5e339f764edec0550.converted" returned: 0 in 0.853s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3baba9d84997e932b5bfa3b5e339f764edec0550.converted --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3baba9d84997e932b5bfa3b5e339f764edec0550.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "3baba9d84997e932b5bfa3b5e339f764edec0550" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.041s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "3baba9d84997e932b5bfa3b5e339f764edec0550" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "3baba9d84997e932b5bfa3b5e339f764edec0550" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3baba9d84997e932b5bfa3b5e339f764edec0550 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3baba9d84997e932b5bfa3b5e339f764edec0550 --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3baba9d84997e932b5bfa3b5e339f764edec0550,backing_fmt=raw /opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e/disk.rescue {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-eb5aeb60-7532-4e8d-9344-7a4b191d225b req-b26984c3-9f5d-4f84-8cef-e3869004f2d6 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received event network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-eb5aeb60-7532-4e8d-9344-7a4b191d225b req-b26984c3-9f5d-4f84-8cef-e3869004f2d6 service nova] Acquiring lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-eb5aeb60-7532-4e8d-9344-7a4b191d225b req-b26984c3-9f5d-4f84-8cef-e3869004f2d6 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-eb5aeb60-7532-4e8d-9344-7a4b191d225b req-b26984c3-9f5d-4f84-8cef-e3869004f2d6 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-eb5aeb60-7532-4e8d-9344-7a4b191d225b req-b26984c3-9f5d-4f84-8cef-e3869004f2d6 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] No waiting events found dispatching network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:04 user nova-compute[75113]: WARNING nova.compute.manager [req-eb5aeb60-7532-4e8d-9344-7a4b191d225b req-b26984c3-9f5d-4f84-8cef-e3869004f2d6 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received unexpected event network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 for instance with vm_state building and task_state spawning.
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3baba9d84997e932b5bfa3b5e339f764edec0550,backing_fmt=raw /opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e/disk.rescue" returned: 0 in 0.055s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "3baba9d84997e932b5bfa3b5e339f764edec0550" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'migration_context' on Instance uuid 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG nova.objects.base [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Object Instance<9593d2bd-4eaf-4cc6-a3ab-8766f769d32e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Start _get_guest_xml network_info=[{"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "vif_mac": "fa:16:3e:96:73:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bd8ee885-77da-41bf-86e6-e63ae11fb058', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2f1ad302-72c7-4b02-83bd-fc6203adf815', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBLDWhkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '9593d2bd-4eaf-4cc6-a3ab-8766f769d32e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a77e10d2-6a5d-4f5a-b37a-bfc05e92453c', 'serial': 'a77e10d2-6a5d-4f5a-b37a-bfc05e92453c'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'resources' on Instance uuid 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG nova.objects.base [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Object Instance<9593d2bd-4eaf-4cc6-a3ab-8766f769d32e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'numa_topology' on Instance uuid 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:04 user nova-compute[75113]: DEBUG nova.objects.base [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Object Instance<9593d2bd-4eaf-4cc6-a3ab-8766f769d32e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:04:05 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:04:05 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.objects.instance [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.objects.base [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Object Instance<9593d2bd-4eaf-4cc6-a3ab-8766f769d32e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBLDWhkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:04:05 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:04:05 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:04:05 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[41722e97-cdb0-451b-a2b2-addc56aa28e9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = lBLDWhkS\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 17:04:05 user nova-compute[75113]: node.name = iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:04:05 user nova-compute[75113]: node.tpgt = -1
Oct 26 17:04:05 user nova-compute[75113]: node.startup = automatic
Oct 26 17:04:05 user nova-compute[75113]: node.leading_login = No
Oct 26 17:04:05 user nova-compute[75113]: iface.iscsi_ifacename = default
Oct 26 17:04:05 user nova-compute[75113]: iface.net_ifacename = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.ipaddress = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.prefix_len = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.hwaddress = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.transport_name = tcp
Oct 26 17:04:05 user nova-compute[75113]: iface.initiatorname = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.state = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.vlan_id = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.vlan_priority = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.vlan_state = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.iface_num = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.mtu = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.port = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.bootproto = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.subnet_mask = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.gateway = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.dhcp_alt_client_id = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.dhcp_dns = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.dhcp_learn_iqn = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.dhcp_vendor_id_state = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.dhcp_vendor_id = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.dhcp_slp_da = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.fragmentation = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.gratuitous_arp = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.incoming_forwarding = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.tos_state = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.tos = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.ttl = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.delayed_ack = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.tcp_nagle = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.tcp_wsf_state = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.tcp_wsf = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.tcp_timer_scale = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.tcp_timestamp = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.redirect = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.def_task_mgmt_timeout = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.header_digest = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.data_digest = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.immediate_data = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.initial_r2t = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.data_seq_inorder = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.data_pdu_inorder = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.erl = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.max_receive_data_len = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.first_burst_len = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.max_outstanding_r2t = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.max_burst_len = 0
Oct 26 17:04:05 user nova-compute[75113]: iface.chap_auth = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.bidi_chap = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.strict_login_compliance = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.discovery_auth = <empty>
Oct 26 17:04:05 user nova-compute[75113]: iface.discovery_logout = <empty>
Oct 26 17:04:05 user nova-compute[75113]: node.discovery_address = <empty>
Oct 26 17:04:05 user nova-compute[75113]: node.discovery_port = 0
Oct 26 17:04:05 user nova-compute[75113]: node.discovery_type = static
Oct 26 17:04:05 user nova-compute[75113]: node.session.initial_cmdsn = 0
Oct 26 17:04:05 user nova-compute[75113]: node.session.initial_login_retry_max = 8
Oct 26 17:04:05 user nova-compute[75113]: node.session.xmit_thread_priority = -20
Oct 26 17:04:05 user nova-compute[75113]: node.session.cmds_max = 128
Oct 26 17:04:05 user nova-compute[75113]: node.session.queue_depth = 32
Oct 26 17:04:05 user nova-compute[75113]: node.session.nr_sessions = 1
Oct 26 17:04:05 user nova-compute[75113]: node.session.auth.authmethod = CHAP
Oct 26 17:04:05 user nova-compute[75113]: node.session.auth.username = lBLDWhkS
Oct 26 17:04:05 user nova-compute[75113]: node.session.auth.password = ***
Oct 26 17:04:05 user nova-compute[75113]: node.session.auth.username_in = <empty>
Oct 26 17:04:05 user nova-compute[75113]: node.session.auth.password_in = <empty>
Oct 26 17:04:05 user nova-compute[75113]: node.session.auth.chap_algs = MD5
Oct 26 17:04:05 user nova-compute[75113]: node.session.timeo.replacement_timeout = 120
Oct 26 17:04:05 user nova-compute[75113]: node.session.err_timeo.abort_timeout = 15
Oct 26 17:04:05 user nova-compute[75113]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 17:04:05 user nova-compute[75113]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 17:04:05 user nova-compute[75113]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 17:04:05 user nova-compute[75113]: node.session.iscsi.FastAbort = Yes
Oct 26 17:04:05 user nova-compute[75113]: node.session.iscsi.InitialR2T = No
Oct 26 17:04:05 user nova-compute[75113]: node.session.iscsi.ImmediateData = Yes
Oct 26 17:04:05 user nova-compute[75113]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 17:04:05 user nova-compute[75113]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 17:04:05 user nova-compute[75113]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 17:04:05 user nova-compute[75113]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 17:04:05 user nova-compute[75113]: node.session.iscsi.MaxConnections = 1
Oct 26 17:04:05 user nova-compute[75113]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 17:04:05 user nova-compute[75113]: node.session.iscsi.ERL = 0
Oct 26 17:04:05 user nova-compute[75113]: node.session.scan = manual
Oct 26 17:04:05 user nova-compute[75113]: node.session.reopen_max = 0
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].address = 172.16.0.220
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].port = 3260
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].startup = manual
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].tcp.window_size = 524288
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].tcp.type_of_service = 0
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].timeo.logout_timeout = 15
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].timeo.login_timeout = 15
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].timeo.auth_timeout = 45
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].iscsi.DataDigest = None
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].iscsi.IFMarker = No
Oct 26 17:04:05 user nova-compute[75113]: node.conn[0].iscsi.OFMarker = No
Oct 26 17:04:05 user nova-compute[75113]: # END RECORD
Oct 26 17:04:05 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:04:05 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Instance spawned successfully.
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ab0f09-16e6-4730-a2f1-32e146cfbcf9]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab8314c-6747-4355-b182-3dc9d4a00b1f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBLDWhkS {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBLDWhkS" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80a9773-57df-46a2-99c6-561ff6283800]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lBLDWhkS'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b651686-aa9a-42f1-943a-d437c50da8b1]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:05 user nova-compute[75113]: INFO nova.compute.manager [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Took 5.95 seconds to spawn the instance on the hypervisor.
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6684b8ee-8349-4421-85ad-d8dbf86bfb46]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:04:05 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:05 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:04:05 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:04:05 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:04:05 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:05 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:04:05 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:05 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:04:05 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:04:05 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:04:05 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:05 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.214s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] HCTL ('35', '0', '0', 0) found on session 18 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef6679b-e836-4311-8802-0c77863ad433]: (4, ('0 0 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching for a device in session 18 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBLDWhkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.242s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] <== connect_volume: return (243ms) {'type': 'block', 'scsi_wwn': '26537396537313237', 'path': '/dev/sdd'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537396537313237', 'path': '/dev/sdd'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1869311728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1869311728',id=18,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:02:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-a30od5ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:02:19Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=9593d2bd-4eaf-4cc6-a3ab-8766f769d32e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "vif_mac": "fa:16:3e:96:73:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "vif_mac": "fa:16:3e:96:73:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:73:98,bridge_name='br-int',has_traffic_filtering=True,id=2f8541b1-74e9-4dd3-ad25-bcf31b21f605,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8541b1-74') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.objects.instance [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'pci_devices' on Instance uuid 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.objects.base [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Object Instance<9593d2bd-4eaf-4cc6-a3ab-8766f769d32e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:04:05 user nova-compute[75113]:   <uuid>9593d2bd-4eaf-4cc6-a3ab-8766f769d32e</uuid>
Oct 26 17:04:05 user nova-compute[75113]:   <name>instance-00000012</name>
Oct 26 17:04:05 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:04:05 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:04:05 user nova-compute[75113]:   <metadata>
Oct 26 17:04:05 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:04:05 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:04:05 user nova-compute[75113]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1869311728</nova:name>
Oct 26 17:04:05 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:04:05</nova:creationTime>
Oct 26 17:04:05 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:04:05 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:04:05 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:04:05 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:04:05 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:04:05 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:04:05 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:04:05 user nova-compute[75113]:       <nova:owner>
Oct 26 17:04:05 user nova-compute[75113]:         <nova:user uuid="c431350f06fd4dbf8d74835f34626ee7">tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member</nova:user>
Oct 26 17:04:05 user nova-compute[75113]:         <nova:project uuid="9ae5d124cb054dfbbe04433a685903bc">tempest-ServerBootFromVolumeStableRescueTest-2080298495</nova:project>
Oct 26 17:04:05 user nova-compute[75113]:       </nova:owner>
Oct 26 17:04:05 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:04:05 user nova-compute[75113]:       <nova:ports>
Oct 26 17:04:05 user nova-compute[75113]:         <nova:port uuid="2f8541b1-74e9-4dd3-ad25-bcf31b21f605">
Oct 26 17:04:05 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 17:04:05 user nova-compute[75113]:         </nova:port>
Oct 26 17:04:05 user nova-compute[75113]:       </nova:ports>
Oct 26 17:04:05 user nova-compute[75113]:     </nova:instance>
Oct 26 17:04:05 user nova-compute[75113]:   </metadata>
Oct 26 17:04:05 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:04:05 user nova-compute[75113]:     <system>
Oct 26 17:04:05 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:04:05 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:04:05 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:04:05 user nova-compute[75113]:       <entry name="serial">9593d2bd-4eaf-4cc6-a3ab-8766f769d32e</entry>
Oct 26 17:04:05 user nova-compute[75113]:       <entry name="uuid">9593d2bd-4eaf-4cc6-a3ab-8766f769d32e</entry>
Oct 26 17:04:05 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:04:05 user nova-compute[75113]:     </system>
Oct 26 17:04:05 user nova-compute[75113]:   </sysinfo>
Oct 26 17:04:05 user nova-compute[75113]:   <os>
Oct 26 17:04:05 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:04:05 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:04:05 user nova-compute[75113]:   </os>
Oct 26 17:04:05 user nova-compute[75113]:   <features>
Oct 26 17:04:05 user nova-compute[75113]:     <acpi/>
Oct 26 17:04:05 user nova-compute[75113]:     <apic/>
Oct 26 17:04:05 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:04:05 user nova-compute[75113]:   </features>
Oct 26 17:04:05 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:04:05 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:04:05 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:04:05 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:04:05 user nova-compute[75113]:   </clock>
Oct 26 17:04:05 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:04:05 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:04:05 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:04:05 user nova-compute[75113]:   </cpu>
Oct 26 17:04:05 user nova-compute[75113]:   <devices>
Oct 26 17:04:05 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:04:05 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:04:05 user nova-compute[75113]:       <source dev="/dev/sdd"/>
Oct 26 17:04:05 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:04:05 user nova-compute[75113]:       <serial>a77e10d2-6a5d-4f5a-b37a-bfc05e92453c</serial>
Oct 26 17:04:05 user nova-compute[75113]:     </disk>
Oct 26 17:04:05 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:04:05 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:04:05 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e/disk.rescue"/>
Oct 26 17:04:05 user nova-compute[75113]:       <target dev="vdb" bus="virtio"/>
Oct 26 17:04:05 user nova-compute[75113]:       <boot order="1"/>
Oct 26 17:04:05 user nova-compute[75113]:     </disk>
Oct 26 17:04:05 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:04:05 user nova-compute[75113]:       <mac address="fa:16:3e:96:73:98"/>
Oct 26 17:04:05 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:04:05 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:04:05 user nova-compute[75113]:       <target dev="tap2f8541b1-74"/>
Oct 26 17:04:05 user nova-compute[75113]:     </interface>
Oct 26 17:04:05 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:04:05 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e/console.log" append="off"/>
Oct 26 17:04:05 user nova-compute[75113]:     </serial>
Oct 26 17:04:05 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:04:05 user nova-compute[75113]:     <video>
Oct 26 17:04:05 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:04:05 user nova-compute[75113]:     </video>
Oct 26 17:04:05 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:04:05 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:04:05 user nova-compute[75113]:     </rng>
Oct 26 17:04:05 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:04:05 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:04:05 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:04:05 user nova-compute[75113]:     </memballoon>
Oct 26 17:04:05 user nova-compute[75113]:   </devices>
Oct 26 17:04:05 user nova-compute[75113]: </domain>
Oct 26 17:04:05 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:04:05 user nova-compute[75113]: INFO nova.compute.manager [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Took 32.74 seconds to build instance.
Oct 26 17:04:05 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Instance destroyed successfully.
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cd0be2d2-caa9-4d97-86e3-4a7ba437fcbc tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.848s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No VIF found with MAC fa:16:3e:96:73:98, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-1cd46a94-668c-4dc8-bc88-218efea810fc req-99cf2542-270b-4117-bde5-3f218c027617 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1cd46a94-668c-4dc8-bc88-218efea810fc req-99cf2542-270b-4117-bde5-3f218c027617 service nova] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1cd46a94-668c-4dc8-bc88-218efea810fc req-99cf2542-270b-4117-bde5-3f218c027617 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1cd46a94-668c-4dc8-bc88-218efea810fc req-99cf2542-270b-4117-bde5-3f218c027617 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-1cd46a94-668c-4dc8-bc88-218efea810fc req-99cf2542-270b-4117-bde5-3f218c027617 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] No waiting events found dispatching network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:07 user nova-compute[75113]: WARNING nova.compute.manager [req-1cd46a94-668c-4dc8-bc88-218efea810fc req-99cf2542-270b-4117-bde5-3f218c027617 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received unexpected event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 for instance with vm_state active and task_state rescuing.
Oct 26 17:04:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-d1e74a26-5302-4ef5-986f-c2c954bcc0c3 req-2bfca6f4-a0c4-4a33-8b5b-ac03f470b889 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1e74a26-5302-4ef5-986f-c2c954bcc0c3 req-2bfca6f4-a0c4-4a33-8b5b-ac03f470b889 service nova] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1e74a26-5302-4ef5-986f-c2c954bcc0c3 req-2bfca6f4-a0c4-4a33-8b5b-ac03f470b889 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1e74a26-5302-4ef5-986f-c2c954bcc0c3 req-2bfca6f4-a0c4-4a33-8b5b-ac03f470b889 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-d1e74a26-5302-4ef5-986f-c2c954bcc0c3 req-2bfca6f4-a0c4-4a33-8b5b-ac03f470b889 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] No waiting events found dispatching network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:09 user nova-compute[75113]: WARNING nova.compute.manager [req-d1e74a26-5302-4ef5-986f-c2c954bcc0c3 req-2bfca6f4-a0c4-4a33-8b5b-ac03f470b889 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received unexpected event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 for instance with vm_state active and task_state rescuing.
Oct 26 17:04:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7f659d36-f8af-4942-8922-08a814451320 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:04:09 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:04:09 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7070MB free_disk=25.06629180908203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 76039e5a-db02-48b4-81eb-a7383d1374b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance a2bbd45c-c153-408c-ba58-2f161963989e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 37683519-d90a-4fa4-8e8f-cc883a2573ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:04:09 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:04:10 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:04:10 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:04:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:04:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.721s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Acquiring lock "a2bbd45c-c153-408c-ba58-2f161963989e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "a2bbd45c-c153-408c-ba58-2f161963989e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Acquiring lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:12 user nova-compute[75113]: INFO nova.compute.manager [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Terminating instance
Oct 26 17:04:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG nova.compute.manager [req-1b523498-e19c-4416-be25-f28bf17aea7e req-a9ccca50-0d19-40bf-81c1-e61657a2aff5 service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Received event network-vif-unplugged-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1b523498-e19c-4416-be25-f28bf17aea7e req-a9ccca50-0d19-40bf-81c1-e61657a2aff5 service nova] Acquiring lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1b523498-e19c-4416-be25-f28bf17aea7e req-a9ccca50-0d19-40bf-81c1-e61657a2aff5 service nova] Lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1b523498-e19c-4416-be25-f28bf17aea7e req-a9ccca50-0d19-40bf-81c1-e61657a2aff5 service nova] Lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG nova.compute.manager [req-1b523498-e19c-4416-be25-f28bf17aea7e req-a9ccca50-0d19-40bf-81c1-e61657a2aff5 service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] No waiting events found dispatching network-vif-unplugged-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG nova.compute.manager [req-1b523498-e19c-4416-be25-f28bf17aea7e req-a9ccca50-0d19-40bf-81c1-e61657a2aff5 service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Received event network-vif-unplugged-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:04:12 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Instance destroyed successfully.
Oct 26 17:04:12 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lazy-loading 'resources' on Instance uuid a2bbd45c-c153-408c-ba58-2f161963989e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-750716619',display_name='tempest-VolumesActionsTest-instance-750716619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-750716619',id=19,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:01:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d231966ad7514ad387c1976bf2d97416',ramdisk_id='',reservation_id='r-93ds0dmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1136981146',owner_user_name='tempest-VolumesActionsTest-1136981146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:01:54Z,user_data=None,user_id='4dd2483aed9547feaa14f83b05f27a23',uuid=a2bbd45c-c153-408c-ba58-2f161963989e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "address": "fa:16:3e:41:1e:cf", "network": {"id": "7e3cb9cc-c0e9-4479-a6e1-4969e18b1554", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424467201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d231966ad7514ad387c1976bf2d97416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d49e1ab-39", "ovs_interfaceid": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Converting VIF {"id": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "address": "fa:16:3e:41:1e:cf", "network": {"id": "7e3cb9cc-c0e9-4479-a6e1-4969e18b1554", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424467201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d231966ad7514ad387c1976bf2d97416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d49e1ab-39", "ovs_interfaceid": "3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:1e:cf,bridge_name='br-int',has_traffic_filtering=True,id=3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8,network=Network(7e3cb9cc-c0e9-4479-a6e1-4969e18b1554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d49e1ab-39') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG os_vif [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:1e:cf,bridge_name='br-int',has_traffic_filtering=True,id=3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8,network=Network(7e3cb9cc-c0e9-4479-a6e1-4969e18b1554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d49e1ab-39') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d49e1ab-39, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e330f97-56eb-4f2a-b8b5-28af98ccc6d1) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:12 user nova-compute[75113]: INFO os_vif [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:1e:cf,bridge_name='br-int',has_traffic_filtering=True,id=3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8,network=Network(7e3cb9cc-c0e9-4479-a6e1-4969e18b1554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d49e1ab-39')
Oct 26 17:04:12 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Deleting instance files /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e_del
Oct 26 17:04:12 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Deletion of /opt/stack/data/nova/instances/a2bbd45c-c153-408c-ba58-2f161963989e_del complete
Oct 26 17:04:12 user nova-compute[75113]: INFO nova.compute.manager [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Took 0.82 seconds to destroy the instance on the hypervisor.
Oct 26 17:04:12 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:04:12 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:04:13 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:04:13 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Took 0.60 seconds to deallocate network for instance.
Oct 26 17:04:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:13 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:04:14 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:04:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:14 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Deleted allocations for instance a2bbd45c-c153-408c-ba58-2f161963989e
Oct 26 17:04:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2ccc80ba-f659-4494-a1ed-b55db77db02f tempest-VolumesActionsTest-1136981146 tempest-VolumesActionsTest-1136981146-project-member] Lock "a2bbd45c-c153-408c-ba58-2f161963989e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.146s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-ce6bde50-b26d-49d3-a0cc-e7b5bdc8477b req-3d74e832-5cd4-4dc6-8a04-6adab4eb5839 service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Received event network-vif-plugged-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ce6bde50-b26d-49d3-a0cc-e7b5bdc8477b req-3d74e832-5cd4-4dc6-8a04-6adab4eb5839 service nova] Acquiring lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ce6bde50-b26d-49d3-a0cc-e7b5bdc8477b req-3d74e832-5cd4-4dc6-8a04-6adab4eb5839 service nova] Lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ce6bde50-b26d-49d3-a0cc-e7b5bdc8477b req-3d74e832-5cd4-4dc6-8a04-6adab4eb5839 service nova] Lock "a2bbd45c-c153-408c-ba58-2f161963989e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-ce6bde50-b26d-49d3-a0cc-e7b5bdc8477b req-3d74e832-5cd4-4dc6-8a04-6adab4eb5839 service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] No waiting events found dispatching network-vif-plugged-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:14 user nova-compute[75113]: WARNING nova.compute.manager [req-ce6bde50-b26d-49d3-a0cc-e7b5bdc8477b req-3d74e832-5cd4-4dc6-8a04-6adab4eb5839 service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Received unexpected event network-vif-plugged-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 for instance with vm_state deleted and task_state None.
Oct 26 17:04:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-ce6bde50-b26d-49d3-a0cc-e7b5bdc8477b req-3d74e832-5cd4-4dc6-8a04-6adab4eb5839 service nova] [instance: a2bbd45c-c153-408c-ba58-2f161963989e] Received event network-vif-deleted-3d49e1ab-39db-40ee-aa0f-fe0e45eb0db8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:20 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 is timed out.
Oct 26 17:04:20 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Successfully detached device vdb from instance 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 from the live domain config.
Oct 26 17:04:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYXwaZAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:04:20 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ac0fb4-3763-4c98-b8c7-6ef5523e888c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:04:20 user nova-compute[75113]: No targets found.
Oct 26 17:04:20 user nova-compute[75113]: iSNS:
Oct 26 17:04:20 user nova-compute[75113]: No targets found.
Oct 26 17:04:20 user nova-compute[75113]: STATIC:
Oct 26 17:04:20 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4
Oct 26 17:04:20 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:20 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:20 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b
Oct 26 17:04:20 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:20 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:20 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597
Oct 26 17:04:20 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:20 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:20 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:04:20 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:20 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:20 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620
Oct 26 17:04:20 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:20 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:20 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24
Oct 26 17:04:20 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:20 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:20 user nova-compute[75113]: FIRMWARE:
Oct 26 17:04:20 user nova-compute[75113]: No targets found.
Oct 26 17:04:20 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:04:20 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:04:20 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a521e8ae-d094-4d71-9cb2-d808fbcc92ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[301ec731-a3b0-45a1-8029-05602b5576d0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:04:20 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:20 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:04:20 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:04:20 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:04:20 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:20 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 (non-flash)
Oct 26 17:04:20 user nova-compute[75113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:20 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:04:20 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:04:20 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:04:20 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:20 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914236dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597'): ({'sdc'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Removing single pathed devices sdc {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe30f67-3201-48df-abd5-b1c5fb62a58d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1963b6-ad30-4153-b22a-0f35391744c9]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Flushing IO for device /dev/sdc {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3369e0f0-ba8f-4311-ae41-455d74d27660]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8115279-81aa-4ffb-8a47-d55825876e69]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba5c2a6-8eb6-4aca-9579-7893f3135aff]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d08c70-3acc-43d1-8615-e74929e9687a]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260]
Oct 26 17:04:20 user nova-compute[75113]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597, portal: 172.16.0.220,3260] successful.
Oct 26 17:04:20 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0274fd0-61fa-4d16-a99a-c91310ce3597 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d5705e-e808-40c8-ade9-3c07dacd4f61]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] <== disconnect_volume: return (425ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:04:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:04:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-227b489f-8dfe-4e41-a599-281a62f8a84a req-39e65de8-f0db-40e2-b96b-cc327fdb2238 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-changed-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-227b489f-8dfe-4e41-a599-281a62f8a84a req-39e65de8-f0db-40e2-b96b-cc327fdb2238 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing instance network info cache due to event network-changed-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:04:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-227b489f-8dfe-4e41-a599-281a62f8a84a req-39e65de8-f0db-40e2-b96b-cc327fdb2238 service nova] Acquiring lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:04:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-227b489f-8dfe-4e41-a599-281a62f8a84a req-39e65de8-f0db-40e2-b96b-cc327fdb2238 service nova] Acquired lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:04:21 user nova-compute[75113]: DEBUG nova.network.neutron [req-227b489f-8dfe-4e41-a599-281a62f8a84a req-39e65de8-f0db-40e2-b96b-cc327fdb2238 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Refreshing network info cache for port 95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:04:21 user nova-compute[75113]: DEBUG nova.network.neutron [req-227b489f-8dfe-4e41-a599-281a62f8a84a req-39e65de8-f0db-40e2-b96b-cc327fdb2238 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updated VIF entry in instance network info cache for port 95cf0eba-473a-4dfd-a3a7-1d8fec6399ce. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:04:21 user nova-compute[75113]: DEBUG nova.network.neutron [req-227b489f-8dfe-4e41-a599-281a62f8a84a req-39e65de8-f0db-40e2-b96b-cc327fdb2238 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating instance_info_cache with network_info: [{"id": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "address": "fa:16:3e:62:67:cf", "network": {"id": "e7216aad-39cb-4142-8c1f-dce1020dcc12", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-111571776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cf0eba-47", "ovs_interfaceid": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "address": "fa:16:3e:de:4c:5a", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa8c9bd5-e4", "ovs_interfaceid": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "address": "fa:16:3e:6f:10:8d", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eaa7ff-68", "ovs_interfaceid": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "address": "fa:16:3e:54:87:08", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1957f9-f8", "ovs_interfaceid": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "address": "fa:16:3e:03:49:9c", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfb2aba-69", "ovs_interfaceid": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "037fd8ce-526b-4c04-bd17-4402781e28ed", "address": "fa:16:3e:d2:0b:83", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037fd8ce-52", "ovs_interfaceid": "037fd8ce-526b-4c04-bd17-4402781e28ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c34234e-daf0-44a0-8c1c-94721e415e19", "address": "fa:16:3e:e2:4b:a1", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c34234e-da", "ovs_interfaceid": "5c34234e-daf0-44a0-8c1c-94721e415e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:04:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-227b489f-8dfe-4e41-a599-281a62f8a84a req-39e65de8-f0db-40e2-b96b-cc327fdb2238 service nova] Releasing lock "refresh_cache-76039e5a-db02-48b4-81eb-a7383d1374b1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:04:21 user nova-compute[75113]: DEBUG nova.objects.instance [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'flavor' on Instance uuid 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f7496a8d-ccf1-4a2b-8f8a-f4d766c87f38 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.387s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:23 user nova-compute[75113]: INFO nova.compute.manager [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Terminating instance
Oct 26 17:04:23 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:04:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-3a2ecaad-a443-4742-afd0-1a4d71a58b32 req-613a2301-9467-401a-844c-dc142bd27cfb service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3a2ecaad-a443-4742-afd0-1a4d71a58b32 req-613a2301-9467-401a-844c-dc142bd27cfb service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3a2ecaad-a443-4742-afd0-1a4d71a58b32 req-613a2301-9467-401a-844c-dc142bd27cfb service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3a2ecaad-a443-4742-afd0-1a4d71a58b32 req-613a2301-9467-401a-844c-dc142bd27cfb service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-3a2ecaad-a443-4742-afd0-1a4d71a58b32 req-613a2301-9467-401a-844c-dc142bd27cfb service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-unplugged-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-3a2ecaad-a443-4742-afd0-1a4d71a58b32 req-613a2301-9467-401a-844c-dc142bd27cfb service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-b39b362c-dc6b-43b8-9f03-8913149fec8e req-53354e56-3536-4659-92b5-e3aeb73048d0 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-aa8c9bd5-e40f-45d7-addc-a0f5773791c5 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b39b362c-dc6b-43b8-9f03-8913149fec8e req-53354e56-3536-4659-92b5-e3aeb73048d0 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b39b362c-dc6b-43b8-9f03-8913149fec8e req-53354e56-3536-4659-92b5-e3aeb73048d0 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b39b362c-dc6b-43b8-9f03-8913149fec8e req-53354e56-3536-4659-92b5-e3aeb73048d0 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-b39b362c-dc6b-43b8-9f03-8913149fec8e req-53354e56-3536-4659-92b5-e3aeb73048d0 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-unplugged-aa8c9bd5-e40f-45d7-addc-a0f5773791c5 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-b39b362c-dc6b-43b8-9f03-8913149fec8e req-53354e56-3536-4659-92b5-e3aeb73048d0 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-aa8c9bd5-e40f-45d7-addc-a0f5773791c5 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-8ed508d6-f361-4b57-b31f-afb6682fa9fd req-ec19eb00-c74e-4ae9-8d88-31f3f22d70ba service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-71eaa7ff-686b-4e1b-94b5-0b572d28e68b {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8ed508d6-f361-4b57-b31f-afb6682fa9fd req-ec19eb00-c74e-4ae9-8d88-31f3f22d70ba service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8ed508d6-f361-4b57-b31f-afb6682fa9fd req-ec19eb00-c74e-4ae9-8d88-31f3f22d70ba service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8ed508d6-f361-4b57-b31f-afb6682fa9fd req-ec19eb00-c74e-4ae9-8d88-31f3f22d70ba service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-8ed508d6-f361-4b57-b31f-afb6682fa9fd req-ec19eb00-c74e-4ae9-8d88-31f3f22d70ba service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-unplugged-71eaa7ff-686b-4e1b-94b5-0b572d28e68b {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-8ed508d6-f361-4b57-b31f-afb6682fa9fd req-ec19eb00-c74e-4ae9-8d88-31f3f22d70ba service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-71eaa7ff-686b-4e1b-94b5-0b572d28e68b for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Instance destroyed successfully.
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.objects.instance [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lazy-loading 'resources' on Instance uuid 76039e5a-db02-48b4-81eb-a7383d1374b1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:02:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "address": "fa:16:3e:62:67:cf", "network": {"id": "e7216aad-39cb-4142-8c1f-dce1020dcc12", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-111571776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cf0eba-47", "ovs_interfaceid": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "address": "fa:16:3e:62:67:cf", "network": {"id": "e7216aad-39cb-4142-8c1f-dce1020dcc12", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-111571776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cf0eba-47", "ovs_interfaceid": "95cf0eba-473a-4dfd-a3a7-1d8fec6399ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=95cf0eba-473a-4dfd-a3a7-1d8fec6399ce,network=Network(e7216aad-39cb-4142-8c1f-dce1020dcc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cf0eba-47') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=95cf0eba-473a-4dfd-a3a7-1d8fec6399ce,network=Network(e7216aad-39cb-4142-8c1f-dce1020dcc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cf0eba-47') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95cf0eba-47, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ce20ebc-dfe7-4583-a3a2-1708bf547fd1) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: INFO os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=95cf0eba-473a-4dfd-a3a7-1d8fec6399ce,network=Network(e7216aad-39cb-4142-8c1f-dce1020dcc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cf0eba-47')
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:02:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "address": "fa:16:3e:de:4c:5a", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa8c9bd5-e4", "ovs_interfaceid": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "address": "fa:16:3e:de:4c:5a", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa8c9bd5-e4", "ovs_interfaceid": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=aa8c9bd5-e40f-45d7-addc-a0f5773791c5,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa8c9bd5-e4') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=aa8c9bd5-e40f-45d7-addc-a0f5773791c5,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa8c9bd5-e4') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa8c9bd5-e4, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40b784f9-d91b-4361-a31d-8b07481d0f24) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: INFO os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=aa8c9bd5-e40f-45d7-addc-a0f5773791c5,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa8c9bd5-e4')
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:02:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "address": "fa:16:3e:6f:10:8d", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eaa7ff-68", "ovs_interfaceid": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "address": "fa:16:3e:6f:10:8d", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eaa7ff-68", "ovs_interfaceid": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:10:8d,bridge_name='br-int',has_traffic_filtering=True,id=71eaa7ff-686b-4e1b-94b5-0b572d28e68b,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71eaa7ff-68') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:10:8d,bridge_name='br-int',has_traffic_filtering=True,id=71eaa7ff-686b-4e1b-94b5-0b572d28e68b,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71eaa7ff-68') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71eaa7ff-68, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08257a86-243b-45a4-b9ae-208c81bf9a6e) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: INFO os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:10:8d,bridge_name='br-int',has_traffic_filtering=True,id=71eaa7ff-686b-4e1b-94b5-0b572d28e68b,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71eaa7ff-68')
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:02:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "address": "fa:16:3e:54:87:08", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1957f9-f8", "ovs_interfaceid": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "address": "fa:16:3e:54:87:08", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1957f9-f8", "ovs_interfaceid": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:87:08,bridge_name='br-int',has_traffic_filtering=True,id=fe1957f9-f87b-4d7b-98f9-425e92dbd68d,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1957f9-f8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:87:08,bridge_name='br-int',has_traffic_filtering=True,id=fe1957f9-f87b-4d7b-98f9-425e92dbd68d,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1957f9-f8') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe1957f9-f8, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7977ab6-c29e-4fc9-a749-56c581d952ab) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: INFO os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:87:08,bridge_name='br-int',has_traffic_filtering=True,id=fe1957f9-f87b-4d7b-98f9-425e92dbd68d,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1957f9-f8')
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:02:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "address": "fa:16:3e:03:49:9c", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfb2aba-69", "ovs_interfaceid": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "address": "fa:16:3e:03:49:9c", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfb2aba-69", "ovs_interfaceid": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=1bfb2aba-69ec-49d5-8875-6a2ec2049ac2,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfb2aba-69') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=1bfb2aba-69ec-49d5-8875-6a2ec2049ac2,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfb2aba-69') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bfb2aba-69, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfbc718b-a028-460b-ac61-7aed3fa7f8c9) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: INFO os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=1bfb2aba-69ec-49d5-8875-6a2ec2049ac2,network=Network(2c2d2c09-dc97-476b-8238-d7cad65df099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfb2aba-69')
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:02:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "037fd8ce-526b-4c04-bd17-4402781e28ed", "address": "fa:16:3e:d2:0b:83", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037fd8ce-52", "ovs_interfaceid": "037fd8ce-526b-4c04-bd17-4402781e28ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "037fd8ce-526b-4c04-bd17-4402781e28ed", "address": "fa:16:3e:d2:0b:83", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037fd8ce-52", "ovs_interfaceid": "037fd8ce-526b-4c04-bd17-4402781e28ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:83,bridge_name='br-int',has_traffic_filtering=True,id=037fd8ce-526b-4c04-bd17-4402781e28ed,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037fd8ce-52') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:83,bridge_name='br-int',has_traffic_filtering=True,id=037fd8ce-526b-4c04-bd17-4402781e28ed,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037fd8ce-52') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap037fd8ce-52, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e464adf-4395-4343-a3a4-125d3adf4d7b) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: INFO os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:83,bridge_name='br-int',has_traffic_filtering=True,id=037fd8ce-526b-4c04-bd17-4402781e28ed,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037fd8ce-52')
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T17:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1001851615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1001851615',id=16,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvFECcrKGh/KIQireMpT/p0Sxq1trAGbsMHn0tzlL0pQ/8bLzyc7A1HaVk8gOJDiF7ojefoo+nUAf9GF4ENfMteY3nsUr4nCIlVxFGNamlgKAdP6yM6lMiX8/x2euxR2w==',key_name='tempest-keypair-1758562690',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7ccf18d4d8467f961b5ec1e8df785b',ramdisk_id='',reservation_id='r-k5et9km1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1221982702',owner_user_name='tempest-TaggedBootDevicesTest-1221982702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:02:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4715aee69ed453eb02e312435fb6621',uuid=76039e5a-db02-48b4-81eb-a7383d1374b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c34234e-daf0-44a0-8c1c-94721e415e19", "address": "fa:16:3e:e2:4b:a1", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c34234e-da", "ovs_interfaceid": "5c34234e-daf0-44a0-8c1c-94721e415e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converting VIF {"id": "5c34234e-daf0-44a0-8c1c-94721e415e19", "address": "fa:16:3e:e2:4b:a1", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c34234e-da", "ovs_interfaceid": "5c34234e-daf0-44a0-8c1c-94721e415e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4b:a1,bridge_name='br-int',has_traffic_filtering=True,id=5c34234e-daf0-44a0-8c1c-94721e415e19,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c34234e-da') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4b:a1,bridge_name='br-int',has_traffic_filtering=True,id=5c34234e-daf0-44a0-8c1c-94721e415e19,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c34234e-da') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c34234e-da, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:26 user nova-compute[75113]: WARNING nova.compute.manager [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce for instance with vm_state active and task_state deleting.
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-fe1957f9-f87b-4d7b-98f9-425e92dbd68d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-unplugged-fe1957f9-f87b-4d7b-98f9-425e92dbd68d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-fe1957f9-f87b-4d7b-98f9-425e92dbd68d for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-fe1957f9-f87b-4d7b-98f9-425e92dbd68d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-fe1957f9-f87b-4d7b-98f9-425e92dbd68d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:26 user nova-compute[75113]: WARNING nova.compute.manager [req-3d56db5b-1ea9-4cd8-83b8-355f97cd60fb req-d79332f4-cd2a-4d83-9451-4bb469ae642d service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-fe1957f9-f87b-4d7b-98f9-425e92dbd68d for instance with vm_state active and task_state deleting.
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=751d1a36-eb1d-4e47-be5f-2776fe2849ad) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: INFO os_vif [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4b:a1,bridge_name='br-int',has_traffic_filtering=True,id=5c34234e-daf0-44a0-8c1c-94721e415e19,network=Network(b8901e1e-bf60-446d-a690-e4d6dd78575d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c34234e-da')
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCsygKjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:04:26 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d90fc0a-2338-44c0-acf5-21d273584d24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:04:26 user nova-compute[75113]: No targets found.
Oct 26 17:04:26 user nova-compute[75113]: iSNS:
Oct 26 17:04:26 user nova-compute[75113]: No targets found.
Oct 26 17:04:26 user nova-compute[75113]: STATIC:
Oct 26 17:04:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4
Oct 26 17:04:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b
Oct 26 17:04:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:04:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620
Oct 26 17:04:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24
Oct 26 17:04:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:26 user nova-compute[75113]: FIRMWARE:
Oct 26 17:04:26 user nova-compute[75113]: No targets found.
Oct 26 17:04:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:04:26 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:04:26 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf88a59-905e-44fa-9e59-eda8c71076f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[358314a1-3ce9-47f8-8407-9e2d942246ed]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49143db010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620'): ({'sde'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Removing single pathed devices sde {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d3aefd-1efe-4eb3-b9c1-4af4b0a2e6b4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4fbab5-7048-43b7-88d4-b6f1807a06f0]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Flushing IO for device /dev/sde {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-aa8c9bd5-e40f-45d7-addc-a0f5773791c5 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-aa8c9bd5-e40f-45d7-addc-a0f5773791c5 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:26 user nova-compute[75113]: WARNING nova.compute.manager [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-aa8c9bd5-e40f-45d7-addc-a0f5773791c5 for instance with vm_state active and task_state deleting.
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-5c34234e-daf0-44a0-8c1c-94721e415e19 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-unplugged-5c34234e-daf0-44a0-8c1c-94721e415e19 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-5c34234e-daf0-44a0-8c1c-94721e415e19 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-5c34234e-daf0-44a0-8c1c-94721e415e19 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-5c34234e-daf0-44a0-8c1c-94721e415e19 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:26 user nova-compute[75113]: WARNING nova.compute.manager [req-ad3e4e32-578f-48ef-a8d9-415d87180a2f req-f92f07cf-39e0-46b9-918e-d3b93abd8988 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-5c34234e-daf0-44a0-8c1c-94721e415e19 for instance with vm_state active and task_state deleting.
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8930bdd0-0966-40e8-82a1-e02990895d33]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[601c2ab5-f6b3-4b4b-acc2-06925962079f]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f6f78b-5f4f-4027-88b8-c46fcf027418]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3082de90-5bd1-4d75-849c-acf7aa19e40c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620, portal: 172.16.0.220,3260]
Oct 26 17:04:26 user nova-compute[75113]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620, portal: 172.16.0.220,3260] successful.
Oct 26 17:04:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c72787-3acd-414f-9c4d-af5a4be57620 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.059s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c289351-32c9-4ad3-9feb-4bf2b06db116]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] <== disconnect_volume: return (389ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StXnhUfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:04:26 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2426cd7e-52c4-4ee9-84f3-e2889307b84c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:04:26 user nova-compute[75113]: No targets found.
Oct 26 17:04:26 user nova-compute[75113]: iSNS:
Oct 26 17:04:26 user nova-compute[75113]: No targets found.
Oct 26 17:04:26 user nova-compute[75113]: STATIC:
Oct 26 17:04:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4
Oct 26 17:04:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b
Oct 26 17:04:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:04:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24
Oct 26 17:04:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:26 user nova-compute[75113]: FIRMWARE:
Oct 26 17:04:26 user nova-compute[75113]: No targets found.
Oct 26 17:04:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:04:26 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:04:26 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa853c5-0029-493b-8cea-b52bb4c532bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-71eaa7ff-686b-4e1b-94b5-0b572d28e68b {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-71eaa7ff-686b-4e1b-94b5-0b572d28e68b {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:26 user nova-compute[75113]: WARNING nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-71eaa7ff-686b-4e1b-94b5-0b572d28e68b for instance with vm_state active and task_state deleting.
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-unplugged-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:26 user nova-compute[75113]: WARNING nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 for instance with vm_state active and task_state deleting.
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-037fd8ce-526b-4c04-bd17-4402781e28ed {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-unplugged-037fd8ce-526b-4c04-bd17-4402781e28ed {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-unplugged-037fd8ce-526b-4c04-bd17-4402781e28ed for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-plugged-037fd8ce-526b-4c04-bd17-4402781e28ed {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Acquiring lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] No waiting events found dispatching network-vif-plugged-037fd8ce-526b-4c04-bd17-4402781e28ed {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:26 user nova-compute[75113]: WARNING nova.compute.manager [req-e3b1b54f-7e12-4627-bc81-8d568cadfa84 req-7c35c39c-8734-4a3b-9fbb-209d76935014 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received unexpected event network-vif-plugged-037fd8ce-526b-4c04-bd17-4402781e28ed for instance with vm_state active and task_state deleting.
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e9ae5c-33e0-48dd-ab97-2123446abfc2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f492c32f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b'): ({'sdf'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Removing single pathed devices sdf {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dbbb00-34fa-4c10-9af0-14bd3a237b79]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18d9df9-c26e-4d3c-b960-36266c39af70]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Flushing IO for device /dev/sdf {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4222df56-24fd-499e-9547-4175117c6bc9]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.066s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb4a441-324b-45ba-a823-769389facd21]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] SCSI volumes sdf have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d169ef84-0a07-40e1-8ca1-50433905aedc]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad4934f-19bb-4c3d-988a-462695f0b998]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b, portal: 172.16.0.220,3260]
Oct 26 17:04:26 user nova-compute[75113]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b, portal: 172.16.0.220,3260] successful.
Oct 26 17:04:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302b2aca-51b0-49c5-a4f9-7dbc9530e05b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6483305b-6637-4cdd-85f2-c72deba2fd94]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] <== disconnect_volume: return (383ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRCAOWXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:04:26 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ae17bf-ca8a-43dc-a2a1-d3bf295a3f9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:04:26 user nova-compute[75113]: No targets found.
Oct 26 17:04:26 user nova-compute[75113]: iSNS:
Oct 26 17:04:26 user nova-compute[75113]: No targets found.
Oct 26 17:04:26 user nova-compute[75113]: STATIC:
Oct 26 17:04:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4
Oct 26 17:04:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:04:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24
Oct 26 17:04:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:04:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:04:26 user nova-compute[75113]: FIRMWARE:
Oct 26 17:04:26 user nova-compute[75113]: No targets found.
Oct 26 17:04:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:04:26 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:04:26 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4a1a8b-a701-45e3-a33d-7a6e8ce60be8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70f69d0-1baa-48e8-a13f-c3fb726539bb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:04:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f492c32f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4'): ({'sdg'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Removing single pathed devices sdg {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[54895922-b0a1-4d00-a788-4ca521906c22]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c9daf5-95c7-401c-ba0e-334f8f6dd09d]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Flushing IO for device /dev/sdg {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0936d484-df5a-47d7-ae6a-11d065abd504]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG nova.objects.instance [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lazy-loading 'flavor' on Instance uuid 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[40852400-74d0-4034-8773-22794b2dfc3b]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] SCSI volumes sdg have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc13357a-1312-4fdb-948e-e394ebf3bc1b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:27 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Ignoring supplied device name: /dev/vdb
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ffea13-2452-4f4c-a5f9-3e550f1d73e9]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4, portal: 172.16.0.220,3260]
Oct 26 17:04:27 user nova-compute[75113]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4, portal: 172.16.0.220,3260] successful.
Oct 26 17:04:27 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b438bcd2-60a0-476e-9af3-a729a27dc3f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d1032d-b9b8-4976-800b-3d29de23e934]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] <== disconnect_volume: return (326ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:04:27 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Deleting instance files /opt/stack/data/nova/instances/76039e5a-db02-48b4-81eb-a7383d1374b1_del
Oct 26 17:04:27 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Deletion of /opt/stack/data/nova/instances/76039e5a-db02-48b4-81eb-a7383d1374b1_del complete
Oct 26 17:04:27 user nova-compute[75113]: INFO nova.compute.manager [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Took 3.66 seconds to destroy the instance on the hypervisor.
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:27 user nova-compute[75113]: INFO nova.compute.manager [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Attaching volume c25fb754-b910-43a7-aa08-368f0b708322 to /dev/vdb
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.utils [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b4e304-8dfb-4548-978c-03de3a6abba4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c8bf87-4907-456b-a727-00caeb87ba82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d895759-a9f9-4b50-94a5-1d28e9edee76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0805ee-b4e9-45b0-8a4e-6f9d8171e687]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:04:27 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:04:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e101dc-1e97-4fce-8cc8-b7a41d061d58]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG os_brick.utils [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:04:27 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Updating existing volume attachment record: 5e68cc4a-7576-4d5e-ba39-dc0b4d809b30 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:04:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-9fc1dde7-22e2-4caf-aea9-518fd379d152 req-9afae93f-2a34-4554-9774-b14090280c4f service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Received event network-changed-24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-9fc1dde7-22e2-4caf-aea9-518fd379d152 req-9afae93f-2a34-4554-9774-b14090280c4f service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Refreshing instance network info cache due to event network-changed-24851c98-7984-473a-9920-289d918c2949. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:04:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9fc1dde7-22e2-4caf-aea9-518fd379d152 req-9afae93f-2a34-4554-9774-b14090280c4f service nova] Acquiring lock "refresh_cache-6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:04:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9fc1dde7-22e2-4caf-aea9-518fd379d152 req-9afae93f-2a34-4554-9774-b14090280c4f service nova] Acquired lock "refresh_cache-6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:04:28 user nova-compute[75113]: DEBUG nova.network.neutron [req-9fc1dde7-22e2-4caf-aea9-518fd379d152 req-9afae93f-2a34-4554-9774-b14090280c4f service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Refreshing network info cache for port 24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:04:28 user nova-compute[75113]: DEBUG nova.network.neutron [req-9fc1dde7-22e2-4caf-aea9-518fd379d152 req-9afae93f-2a34-4554-9774-b14090280c4f service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Updated VIF entry in instance network info cache for port 24851c98-7984-473a-9920-289d918c2949. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:04:28 user nova-compute[75113]: DEBUG nova.network.neutron [req-9fc1dde7-22e2-4caf-aea9-518fd379d152 req-9afae93f-2a34-4554-9774-b14090280c4f service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Updating instance_info_cache with network_info: [{"id": "24851c98-7984-473a-9920-289d918c2949", "address": "fa:16:3e:44:26:8c", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24851c98-79", "ovs_interfaceid": "24851c98-7984-473a-9920-289d918c2949", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:04:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9fc1dde7-22e2-4caf-aea9-518fd379d152 req-9afae93f-2a34-4554-9774-b14090280c4f service nova] Releasing lock "refresh_cache-6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:04:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-75462e2e-c3b9-4e9f-8e66-221442199d5f req-a20b2be0-8018-4de4-b338-b1f48d2cd4f4 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-deleted-95cf0eba-473a-4dfd-a3a7-1d8fec6399ce {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:29 user nova-compute[75113]: INFO nova.compute.manager [req-75462e2e-c3b9-4e9f-8e66-221442199d5f req-a20b2be0-8018-4de4-b338-b1f48d2cd4f4 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Neutron deleted interface 95cf0eba-473a-4dfd-a3a7-1d8fec6399ce; detaching it from the instance and deleting it from the info cache
Oct 26 17:04:29 user nova-compute[75113]: DEBUG nova.network.neutron [req-75462e2e-c3b9-4e9f-8e66-221442199d5f req-a20b2be0-8018-4de4-b338-b1f48d2cd4f4 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating instance_info_cache with network_info: [{"id": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "address": "fa:16:3e:de:4c:5a", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa8c9bd5-e4", "ovs_interfaceid": "aa8c9bd5-e40f-45d7-addc-a0f5773791c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "address": "fa:16:3e:6f:10:8d", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eaa7ff-68", "ovs_interfaceid": "71eaa7ff-686b-4e1b-94b5-0b572d28e68b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "address": "fa:16:3e:54:87:08", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1957f9-f8", "ovs_interfaceid": "fe1957f9-f87b-4d7b-98f9-425e92dbd68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "address": "fa:16:3e:03:49:9c", "network": {"id": "2c2d2c09-dc97-476b-8238-d7cad65df099", "bridge": "br-int", "label": "tempest-device-tagging-net1-1742850585", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfb2aba-69", "ovs_interfaceid": "1bfb2aba-69ec-49d5-8875-6a2ec2049ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "037fd8ce-526b-4c04-bd17-4402781e28ed", "address": "fa:16:3e:d2:0b:83", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037fd8ce-52", "ovs_interfaceid": "037fd8ce-526b-4c04-bd17-4402781e28ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c34234e-daf0-44a0-8c1c-94721e415e19", "address": "fa:16:3e:e2:4b:a1", "network": {"id": "b8901e1e-bf60-446d-a690-e4d6dd78575d", "bridge": "br-int", "label": "tempest-device-tagging-net2-504555496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f7ccf18d4d8467f961b5ec1e8df785b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c34234e-da", "ovs_interfaceid": "5c34234e-daf0-44a0-8c1c-94721e415e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:04:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-75462e2e-c3b9-4e9f-8e66-221442199d5f req-a20b2be0-8018-4de4-b338-b1f48d2cd4f4 service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Detach interface failed, port_id=95cf0eba-473a-4dfd-a3a7-1d8fec6399ce, reason: Instance 76039e5a-db02-48b4-81eb-a7383d1374b1 could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:04:30 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:04:30 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Took 3.58 seconds to deallocate network for instance.
Oct 26 17:04:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:32 user nova-compute[75113]: DEBUG nova.compute.manager [req-099c08df-8250-46e3-9bbd-36a0f02688e5 req-70a9ef7f-feec-438e-a506-dd66248b86fe service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-deleted-fe1957f9-f87b-4d7b-98f9-425e92dbd68d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:32 user nova-compute[75113]: DEBUG nova.compute.manager [req-099c08df-8250-46e3-9bbd-36a0f02688e5 req-70a9ef7f-feec-438e-a506-dd66248b86fe service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-deleted-037fd8ce-526b-4c04-bd17-4402781e28ed {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:32 user nova-compute[75113]: DEBUG nova.compute.manager [req-099c08df-8250-46e3-9bbd-36a0f02688e5 req-70a9ef7f-feec-438e-a506-dd66248b86fe service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-deleted-5c34234e-daf0-44a0-8c1c-94721e415e19 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:32 user nova-compute[75113]: DEBUG nova.compute.manager [req-099c08df-8250-46e3-9bbd-36a0f02688e5 req-70a9ef7f-feec-438e-a506-dd66248b86fe service nova] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Received event network-vif-deleted-1bfb2aba-69ec-49d5-8875-6a2ec2049ac2 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:33 user nova-compute[75113]: INFO nova.compute.manager [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] [instance: 76039e5a-db02-48b4-81eb-a7383d1374b1] Took 2.80 seconds to detach 3 volumes for instance.
Oct 26 17:04:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:34 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:04:34 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:04:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:34 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Deleted allocations for instance 76039e5a-db02-48b4-81eb-a7383d1374b1
Oct 26 17:04:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8a0f0dc5-3deb-41c8-90a9-65134912cfd3 tempest-TaggedBootDevicesTest-1221982702 tempest-TaggedBootDevicesTest-1221982702-project-member] Lock "76039e5a-db02-48b4-81eb-a7383d1374b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.704s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbFkRial', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:04:47 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:04:47 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:04:47 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e7abfd-e1a3-40e6-b7dd-37b16249d174]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:04:47 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8c52d3-4a62-43f2-8f20-1fa8d5936f86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322] added
Oct 26 17:04:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dda26c6-8921-42eb-86ac-9cfe07113f93]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0117354b-0f67-4a82-a411-d9bc82648bfc]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TbFkRial {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TbFkRial" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab37c8c-9128-4a14-b0cb-9915ce1f41a3]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TbFkRial'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[18626c15-9013-4463-a9de-72830073d04a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdf1740-f73a-45fc-8711-92c359921adf]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:47 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:47 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d606f2a-4a39-4b84-96d4-aae1c315de37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322, portal: 172.16.0.220,3260]
Oct 26 17:04:47 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322, portal: 172.16.0.220,3260] successful.
Oct 26 17:04:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3823d8-0a74-4cb1-8541-82cbcc514309]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b722c2b3-445e-4d11-87bf-d09e2f835ea2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:47 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:47 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:04:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:04:47 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:04:47 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:04:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[12526753-6d47-49a0-a1e5-d132047eb12f]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:04:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbFkRial', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:04:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:04:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26232343730313737', 'path': '/dev/sdc'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:04:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232343730313737', 'path': '/dev/sdc'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:04:48 user nova-compute[75113]: DEBUG nova.objects.instance [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lazy-loading 'flavor' on Instance uuid 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:04:48 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:04:48 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:04:48 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:04:48 user nova-compute[75113]:   <serial>c25fb754-b910-43a7-aa08-368f0b708322</serial>
Oct 26 17:04:48 user nova-compute[75113]: </disk>
Oct 26 17:04:48 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:04:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:04:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:04:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] No VIF found with MAC fa:16:3e:44:26:8c, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:04:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-03e4dedd-1047-4080-8e82-792d3c0f1077 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.777s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "870b7db3-6425-4596-a942-736eccf07ebd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "870b7db3-6425-4596-a942-736eccf07ebd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:51 user nova-compute[75113]: DEBUG nova.compute.manager [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:04:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:51 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:04:51 user nova-compute[75113]: INFO nova.compute.claims [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Claim successful on node user
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-993c7853-4406-45bd-a884-90ebd076414f req-8e51bff4-c467-40c8-b294-30e1cc99bd73 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received event network-changed-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-993c7853-4406-45bd-a884-90ebd076414f req-8e51bff4-c467-40c8-b294-30e1cc99bd73 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Refreshing instance network info cache due to event network-changed-e8551569-369f-4dfc-a57e-c1c06ed135bf. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-993c7853-4406-45bd-a884-90ebd076414f req-8e51bff4-c467-40c8-b294-30e1cc99bd73 service nova] Acquiring lock "refresh_cache-b07d5f6f-8994-46a8-8c80-c0b803c894b0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-993c7853-4406-45bd-a884-90ebd076414f req-8e51bff4-c467-40c8-b294-30e1cc99bd73 service nova] Acquired lock "refresh_cache-b07d5f6f-8994-46a8-8c80-c0b803c894b0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.network.neutron [req-993c7853-4406-45bd-a884-90ebd076414f req-8e51bff4-c467-40c8-b294-30e1cc99bd73 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Refreshing network info cache for port e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.network.neutron [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:04:52 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.policy [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c81e83d3ea04b2a8dabe3ac53205391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786feb5d295e40868b844a95c26cf661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.network.neutron [req-993c7853-4406-45bd-a884-90ebd076414f req-8e51bff4-c467-40c8-b294-30e1cc99bd73 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Updated VIF entry in instance network info cache for port e8551569-369f-4dfc-a57e-c1c06ed135bf. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.network.neutron [req-993c7853-4406-45bd-a884-90ebd076414f req-8e51bff4-c467-40c8-b294-30e1cc99bd73 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Updating instance_info_cache with network_info: [{"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-993c7853-4406-45bd-a884-90ebd076414f req-8e51bff4-c467-40c8-b294-30e1cc99bd73 service nova] Releasing lock "refresh_cache-b07d5f6f-8994-46a8-8c80-c0b803c894b0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:04:52 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Creating image(s)
Oct 26 17:04:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "/opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "/opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "/opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG nova.objects.instance [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lazy-loading 'flavor' on Instance uuid b07d5f6f-8994-46a8-8c80-c0b803c894b0 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.250s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:53 user nova-compute[75113]: INFO nova.compute.manager [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Attaching volume 7528c15d-6770-43f0-b1dc-705e7d29f804 to /dev/vdb
Oct 26 17:04:53 user nova-compute[75113]: DEBUG os_brick.utils [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.225s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9a0008-d57e-41ac-a107-3c5cd42a1b43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk 1073741824" returned: 0 in 0.051s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8102127-ad85-449f-8443-252dcdd22013]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG nova.network.neutron [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Successfully created port: 83c94f7d-a672-493b-a62c-ea525c08dcd9 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9e2e4a-d7f7-4db0-bbd2-5a979b0d0569]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b665b1-f731-44d8-b732-990ed25d3fa1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:04:53 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1974a5c0-7087-4853-ad4c-1f0c05766773]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG os_brick.utils [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Updating existing volume attachment record: 23cf249e-0406-4b85-9198-10b6849aaf95 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Cannot resize image /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Ensure instance console log exists: /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.network.neutron [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Successfully updated port: 83c94f7d-a672-493b-a62c-ea525c08dcd9 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "refresh_cache-870b7db3-6425-4596-a942-736eccf07ebd" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquired lock "refresh_cache-870b7db3-6425-4596-a942-736eccf07ebd" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.network.neutron [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.network.neutron [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-54e80d2a-591c-49d1-bd86-332c9a53a06f req-04cbdee6-4e41-4ff3-bc14-3e04e529eb8a service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Received event network-changed-83c94f7d-a672-493b-a62c-ea525c08dcd9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-54e80d2a-591c-49d1-bd86-332c9a53a06f req-04cbdee6-4e41-4ff3-bc14-3e04e529eb8a service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Refreshing instance network info cache due to event network-changed-83c94f7d-a672-493b-a62c-ea525c08dcd9. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-54e80d2a-591c-49d1-bd86-332c9a53a06f req-04cbdee6-4e41-4ff3-bc14-3e04e529eb8a service nova] Acquiring lock "refresh_cache-870b7db3-6425-4596-a942-736eccf07ebd" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.network.neutron [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Updating instance_info_cache with network_info: [{"id": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "address": "fa:16:3e:aa:84:c8", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c94f7d-a6", "ovs_interfaceid": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Releasing lock "refresh_cache-870b7db3-6425-4596-a942-736eccf07ebd" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Instance network_info: |[{"id": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "address": "fa:16:3e:aa:84:c8", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c94f7d-a6", "ovs_interfaceid": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-54e80d2a-591c-49d1-bd86-332c9a53a06f req-04cbdee6-4e41-4ff3-bc14-3e04e529eb8a service nova] Acquired lock "refresh_cache-870b7db3-6425-4596-a942-736eccf07ebd" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.network.neutron [req-54e80d2a-591c-49d1-bd86-332c9a53a06f req-04cbdee6-4e41-4ff3-bc14-3e04e529eb8a service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Refreshing network info cache for port 83c94f7d-a672-493b-a62c-ea525c08dcd9 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Start _get_guest_xml network_info=[{"id": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "address": "fa:16:3e:aa:84:c8", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c94f7d-a6", "ovs_interfaceid": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:04:54 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:04:54 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:04:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1203335813',display_name='tempest-ServersNegativeTestJSON-server-1203335813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1203335813',id=26,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='786feb5d295e40868b844a95c26cf661',ramdisk_id='',reservation_id='r-3u8oyt2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1640105602',owner_user_name='tempest-ServersNegativeTestJSON-1640105602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:04:53Z,user_data=None,user_id='0c81e83d3ea04b2a8dabe3ac53205391',uuid=870b7db3-6425-4596-a942-736eccf07ebd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "address": "fa:16:3e:aa:84:c8", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c94f7d-a6", "ovs_interfaceid": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Converting VIF {"id": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "address": "fa:16:3e:aa:84:c8", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c94f7d-a6", "ovs_interfaceid": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=83c94f7d-a672-493b-a62c-ea525c08dcd9,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c94f7d-a6') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.objects.instance [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lazy-loading 'pci_devices' on Instance uuid 870b7db3-6425-4596-a942-736eccf07ebd {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:04:54 user nova-compute[75113]:   <uuid>870b7db3-6425-4596-a942-736eccf07ebd</uuid>
Oct 26 17:04:54 user nova-compute[75113]:   <name>instance-0000001a</name>
Oct 26 17:04:54 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:04:54 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:04:54 user nova-compute[75113]:   <metadata>
Oct 26 17:04:54 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:04:54 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:04:54 user nova-compute[75113]:       <nova:name>tempest-ServersNegativeTestJSON-server-1203335813</nova:name>
Oct 26 17:04:54 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:04:54</nova:creationTime>
Oct 26 17:04:54 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:04:54 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:04:54 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:04:54 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:04:54 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:04:54 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:04:54 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:04:54 user nova-compute[75113]:       <nova:owner>
Oct 26 17:04:54 user nova-compute[75113]:         <nova:user uuid="0c81e83d3ea04b2a8dabe3ac53205391">tempest-ServersNegativeTestJSON-1640105602-project-member</nova:user>
Oct 26 17:04:54 user nova-compute[75113]:         <nova:project uuid="786feb5d295e40868b844a95c26cf661">tempest-ServersNegativeTestJSON-1640105602</nova:project>
Oct 26 17:04:54 user nova-compute[75113]:       </nova:owner>
Oct 26 17:04:54 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:04:54 user nova-compute[75113]:       <nova:ports>
Oct 26 17:04:54 user nova-compute[75113]:         <nova:port uuid="83c94f7d-a672-493b-a62c-ea525c08dcd9">
Oct 26 17:04:54 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 17:04:54 user nova-compute[75113]:         </nova:port>
Oct 26 17:04:54 user nova-compute[75113]:       </nova:ports>
Oct 26 17:04:54 user nova-compute[75113]:     </nova:instance>
Oct 26 17:04:54 user nova-compute[75113]:   </metadata>
Oct 26 17:04:54 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:04:54 user nova-compute[75113]:     <system>
Oct 26 17:04:54 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:04:54 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:04:54 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:04:54 user nova-compute[75113]:       <entry name="serial">870b7db3-6425-4596-a942-736eccf07ebd</entry>
Oct 26 17:04:54 user nova-compute[75113]:       <entry name="uuid">870b7db3-6425-4596-a942-736eccf07ebd</entry>
Oct 26 17:04:54 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:04:54 user nova-compute[75113]:     </system>
Oct 26 17:04:54 user nova-compute[75113]:   </sysinfo>
Oct 26 17:04:54 user nova-compute[75113]:   <os>
Oct 26 17:04:54 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:04:54 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:04:54 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:04:54 user nova-compute[75113]:   </os>
Oct 26 17:04:54 user nova-compute[75113]:   <features>
Oct 26 17:04:54 user nova-compute[75113]:     <acpi/>
Oct 26 17:04:54 user nova-compute[75113]:     <apic/>
Oct 26 17:04:54 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:04:54 user nova-compute[75113]:   </features>
Oct 26 17:04:54 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:04:54 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:04:54 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:04:54 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:04:54 user nova-compute[75113]:   </clock>
Oct 26 17:04:54 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:04:54 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:04:54 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:04:54 user nova-compute[75113]:   </cpu>
Oct 26 17:04:54 user nova-compute[75113]:   <devices>
Oct 26 17:04:54 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:04:54 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:04:54 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk"/>
Oct 26 17:04:54 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:04:54 user nova-compute[75113]:     </disk>
Oct 26 17:04:54 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:04:54 user nova-compute[75113]:       <mac address="fa:16:3e:aa:84:c8"/>
Oct 26 17:04:54 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:04:54 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:04:54 user nova-compute[75113]:       <target dev="tap83c94f7d-a6"/>
Oct 26 17:04:54 user nova-compute[75113]:     </interface>
Oct 26 17:04:54 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:04:54 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/console.log" append="off"/>
Oct 26 17:04:54 user nova-compute[75113]:     </serial>
Oct 26 17:04:54 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:04:54 user nova-compute[75113]:     <video>
Oct 26 17:04:54 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:04:54 user nova-compute[75113]:     </video>
Oct 26 17:04:54 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:04:54 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:04:54 user nova-compute[75113]:     </rng>
Oct 26 17:04:54 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:04:54 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:04:54 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:04:54 user nova-compute[75113]:     </memballoon>
Oct 26 17:04:54 user nova-compute[75113]:   </devices>
Oct 26 17:04:54 user nova-compute[75113]: </domain>
Oct 26 17:04:54 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:04:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1203335813',display_name='tempest-ServersNegativeTestJSON-server-1203335813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1203335813',id=26,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='786feb5d295e40868b844a95c26cf661',ramdisk_id='',reservation_id='r-3u8oyt2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1640105602',owner_user_name='tempest-ServersNegativeTestJSON-1640105602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:04:53Z,user_data=None,user_id='0c81e83d3ea04b2a8dabe3ac53205391',uuid=870b7db3-6425-4596-a942-736eccf07ebd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "address": "fa:16:3e:aa:84:c8", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c94f7d-a6", "ovs_interfaceid": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Converting VIF {"id": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "address": "fa:16:3e:aa:84:c8", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c94f7d-a6", "ovs_interfaceid": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=83c94f7d-a672-493b-a62c-ea525c08dcd9,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c94f7d-a6') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG os_vif [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=83c94f7d-a672-493b-a62c-ea525c08dcd9,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c94f7d-a6') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7375903-5b90-5451-b626-f2ea8325d6ed', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83c94f7d-a6, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83c94f7d-a6, col_values=(('qos', UUID('1d849634-39a1-4c39-91a3-9d3c2c12d4fd')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83c94f7d-a6, col_values=(('external_ids', {'iface-id': '83c94f7d-a672-493b-a62c-ea525c08dcd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:84:c8', 'vm-uuid': '870b7db3-6425-4596-a942-736eccf07ebd'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:54 user nova-compute[75113]: INFO os_vif [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=83c94f7d-a672-493b-a62c-ea525c08dcd9,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c94f7d-a6')
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] No VIF found with MAC fa:16:3e:aa:84:c8, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.network.neutron [req-54e80d2a-591c-49d1-bd86-332c9a53a06f req-04cbdee6-4e41-4ff3-bc14-3e04e529eb8a service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Updated VIF entry in instance network info cache for port 83c94f7d-a672-493b-a62c-ea525c08dcd9. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG nova.network.neutron [req-54e80d2a-591c-49d1-bd86-332c9a53a06f req-04cbdee6-4e41-4ff3-bc14-3e04e529eb8a service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Updating instance_info_cache with network_info: [{"id": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "address": "fa:16:3e:aa:84:c8", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c94f7d-a6", "ovs_interfaceid": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:04:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-54e80d2a-591c-49d1-bd86-332c9a53a06f req-04cbdee6-4e41-4ff3-bc14-3e04e529eb8a service nova] Releasing lock "refresh_cache-870b7db3-6425-4596-a942-736eccf07ebd" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:04:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:55 user nova-compute[75113]: INFO nova.compute.manager [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Rescuing
Oct 26 17:04:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:04:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquired lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:04:55 user nova-compute[75113]: DEBUG nova.network.neutron [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:04:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-2784ff96-cf55-49e3-82a9-ded51b0d2bd7 req-91ed9637-8d87-4c10-9ef9-419aeaebce61 service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Received event network-vif-plugged-83c94f7d-a672-493b-a62c-ea525c08dcd9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2784ff96-cf55-49e3-82a9-ded51b0d2bd7 req-91ed9637-8d87-4c10-9ef9-419aeaebce61 service nova] Acquiring lock "870b7db3-6425-4596-a942-736eccf07ebd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2784ff96-cf55-49e3-82a9-ded51b0d2bd7 req-91ed9637-8d87-4c10-9ef9-419aeaebce61 service nova] Lock "870b7db3-6425-4596-a942-736eccf07ebd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2784ff96-cf55-49e3-82a9-ded51b0d2bd7 req-91ed9637-8d87-4c10-9ef9-419aeaebce61 service nova] Lock "870b7db3-6425-4596-a942-736eccf07ebd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-2784ff96-cf55-49e3-82a9-ded51b0d2bd7 req-91ed9637-8d87-4c10-9ef9-419aeaebce61 service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] No waiting events found dispatching network-vif-plugged-83c94f7d-a672-493b-a62c-ea525c08dcd9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:56 user nova-compute[75113]: WARNING nova.compute.manager [req-2784ff96-cf55-49e3-82a9-ded51b0d2bd7 req-91ed9637-8d87-4c10-9ef9-419aeaebce61 service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Received unexpected event network-vif-plugged-83c94f7d-a672-493b-a62c-ea525c08dcd9 for instance with vm_state building and task_state spawning.
Oct 26 17:04:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:56 user nova-compute[75113]: DEBUG nova.network.neutron [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Updating instance_info_cache with network_info: [{"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:04:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Releasing lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:04:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-35f6a9c8-d04c-4491-bff1-d3fa6c85a353 req-7ce6ce46-770d-4d3b-a700-cf544461f3a4 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-unplugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-35f6a9c8-d04c-4491-bff1-d3fa6c85a353 req-7ce6ce46-770d-4d3b-a700-cf544461f3a4 service nova] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-35f6a9c8-d04c-4491-bff1-d3fa6c85a353 req-7ce6ce46-770d-4d3b-a700-cf544461f3a4 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-35f6a9c8-d04c-4491-bff1-d3fa6c85a353 req-7ce6ce46-770d-4d3b-a700-cf544461f3a4 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-35f6a9c8-d04c-4491-bff1-d3fa6c85a353 req-7ce6ce46-770d-4d3b-a700-cf544461f3a4 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] No waiting events found dispatching network-vif-unplugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:57 user nova-compute[75113]: WARNING nova.compute.manager [req-35f6a9c8-d04c-4491-bff1-d3fa6c85a353 req-7ce6ce46-770d-4d3b-a700-cf544461f3a4 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received unexpected event network-vif-unplugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c for instance with vm_state active and task_state rescuing.
Oct 26 17:04:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:04:57 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Instance destroyed successfully.
Oct 26 17:04:57 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Attempting rescue
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75113) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Instance directory exists: not creating {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 17:04:57 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Creating image(s)
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "/opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "/opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "/opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.objects.instance [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.171s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue" returned: 0 in 0.053s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.objects.instance [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'migration_context' on Instance uuid 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.objects.base [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Start _get_guest_xml network_info=[{"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "vif_mac": "fa:16:3e:00:a6:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '91603055-2c31-464d-bb00-ae160ab6e467', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.objects.instance [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'resources' on Instance uuid 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.objects.base [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.objects.instance [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'numa_topology' on Instance uuid 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.objects.base [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:04:57 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:04:57 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.objects.instance [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.objects.base [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1323343316',display_name='tempest-ServerRescueNegativeTestJSON-server-1323343316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1323343316',id=24,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:03:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d11c5d88b2f4a45acee2e9c7d26043a',ramdisk_id='',reservation_id='r-oxsm407w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760587308',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760587308-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:03:16Z,user_data=None,user_id='5aa8e21aab014ce6ace0109878275b8f',uuid=5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "vif_mac": "fa:16:3e:00:a6:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converting VIF {"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "vif_mac": "fa:16:3e:00:a6:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=03fed87a-c881-4ca6-85a3-4440a97ddd8c,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fed87a-c8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.objects.instance [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'pci_devices' on Instance uuid 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.objects.base [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:04:57 user nova-compute[75113]:   <uuid>5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88</uuid>
Oct 26 17:04:57 user nova-compute[75113]:   <name>instance-00000018</name>
Oct 26 17:04:57 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:04:57 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:04:57 user nova-compute[75113]:   <metadata>
Oct 26 17:04:57 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:04:57 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:04:57 user nova-compute[75113]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1323343316</nova:name>
Oct 26 17:04:57 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:04:57</nova:creationTime>
Oct 26 17:04:57 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:04:57 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:04:57 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:04:57 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:04:57 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:04:57 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:04:57 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:04:57 user nova-compute[75113]:       <nova:owner>
Oct 26 17:04:57 user nova-compute[75113]:         <nova:user uuid="5aa8e21aab014ce6ace0109878275b8f">tempest-ServerRescueNegativeTestJSON-1760587308-project-member</nova:user>
Oct 26 17:04:57 user nova-compute[75113]:         <nova:project uuid="2d11c5d88b2f4a45acee2e9c7d26043a">tempest-ServerRescueNegativeTestJSON-1760587308</nova:project>
Oct 26 17:04:57 user nova-compute[75113]:       </nova:owner>
Oct 26 17:04:57 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:04:57 user nova-compute[75113]:       <nova:ports>
Oct 26 17:04:57 user nova-compute[75113]:         <nova:port uuid="03fed87a-c881-4ca6-85a3-4440a97ddd8c">
Oct 26 17:04:57 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 17:04:57 user nova-compute[75113]:         </nova:port>
Oct 26 17:04:57 user nova-compute[75113]:       </nova:ports>
Oct 26 17:04:57 user nova-compute[75113]:     </nova:instance>
Oct 26 17:04:57 user nova-compute[75113]:   </metadata>
Oct 26 17:04:57 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:04:57 user nova-compute[75113]:     <system>
Oct 26 17:04:57 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:04:57 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:04:57 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:04:57 user nova-compute[75113]:       <entry name="serial">5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88</entry>
Oct 26 17:04:57 user nova-compute[75113]:       <entry name="uuid">5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88</entry>
Oct 26 17:04:57 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:04:57 user nova-compute[75113]:     </system>
Oct 26 17:04:57 user nova-compute[75113]:   </sysinfo>
Oct 26 17:04:57 user nova-compute[75113]:   <os>
Oct 26 17:04:57 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:04:57 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:04:57 user nova-compute[75113]:   </os>
Oct 26 17:04:57 user nova-compute[75113]:   <features>
Oct 26 17:04:57 user nova-compute[75113]:     <acpi/>
Oct 26 17:04:57 user nova-compute[75113]:     <apic/>
Oct 26 17:04:57 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:04:57 user nova-compute[75113]:   </features>
Oct 26 17:04:57 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:04:57 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:04:57 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:04:57 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:04:57 user nova-compute[75113]:   </clock>
Oct 26 17:04:57 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:04:57 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:04:57 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:04:57 user nova-compute[75113]:   </cpu>
Oct 26 17:04:57 user nova-compute[75113]:   <devices>
Oct 26 17:04:57 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:04:57 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:04:57 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue"/>
Oct 26 17:04:57 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:04:57 user nova-compute[75113]:     </disk>
Oct 26 17:04:57 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:04:57 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:04:57 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk"/>
Oct 26 17:04:57 user nova-compute[75113]:       <target dev="vdb" bus="virtio"/>
Oct 26 17:04:57 user nova-compute[75113]:     </disk>
Oct 26 17:04:57 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:04:57 user nova-compute[75113]:       <mac address="fa:16:3e:00:a6:36"/>
Oct 26 17:04:57 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:04:57 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:04:57 user nova-compute[75113]:       <target dev="tap03fed87a-c8"/>
Oct 26 17:04:57 user nova-compute[75113]:     </interface>
Oct 26 17:04:57 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:04:57 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/console.log" append="off"/>
Oct 26 17:04:57 user nova-compute[75113]:     </serial>
Oct 26 17:04:57 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:04:57 user nova-compute[75113]:     <video>
Oct 26 17:04:57 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:04:57 user nova-compute[75113]:     </video>
Oct 26 17:04:57 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:04:57 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:04:57 user nova-compute[75113]:     </rng>
Oct 26 17:04:57 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:04:57 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:04:57 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:04:57 user nova-compute[75113]:     </memballoon>
Oct 26 17:04:57 user nova-compute[75113]:   </devices>
Oct 26 17:04:57 user nova-compute[75113]: </domain>
Oct 26 17:04:57 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:04:57 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Instance destroyed successfully.
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:04:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No VIF found with MAC fa:16:3e:00:a6:36, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:04:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-3e32c487-38fa-44bf-84c1-3f3a919e841a req-838e19c2-d906-45d4-a236-9cb3781d2a6e service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Received event network-vif-plugged-83c94f7d-a672-493b-a62c-ea525c08dcd9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3e32c487-38fa-44bf-84c1-3f3a919e841a req-838e19c2-d906-45d4-a236-9cb3781d2a6e service nova] Acquiring lock "870b7db3-6425-4596-a942-736eccf07ebd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3e32c487-38fa-44bf-84c1-3f3a919e841a req-838e19c2-d906-45d4-a236-9cb3781d2a6e service nova] Lock "870b7db3-6425-4596-a942-736eccf07ebd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3e32c487-38fa-44bf-84c1-3f3a919e841a req-838e19c2-d906-45d4-a236-9cb3781d2a6e service nova] Lock "870b7db3-6425-4596-a942-736eccf07ebd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-3e32c487-38fa-44bf-84c1-3f3a919e841a req-838e19c2-d906-45d4-a236-9cb3781d2a6e service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] No waiting events found dispatching network-vif-plugged-83c94f7d-a672-493b-a62c-ea525c08dcd9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:58 user nova-compute[75113]: WARNING nova.compute.manager [req-3e32c487-38fa-44bf-84c1-3f3a919e841a req-838e19c2-d906-45d4-a236-9cb3781d2a6e service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Received unexpected event network-vif-plugged-83c94f7d-a672-493b-a62c-ea525c08dcd9 for instance with vm_state building and task_state spawning.
Oct 26 17:04:58 user nova-compute[75113]: DEBUG nova.compute.manager [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:04:58 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:04:58 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Instance spawned successfully.
Oct 26 17:04:58 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:04:58 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:04:58 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:04:58 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:04:58 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:04:58 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:04:58 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:04:58 user nova-compute[75113]: INFO nova.compute.manager [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Took 5.76 seconds to spawn the instance on the hypervisor.
Oct 26 17:04:58 user nova-compute[75113]: DEBUG nova.compute.manager [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:04:58 user nova-compute[75113]: INFO nova.compute.manager [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Took 6.76 seconds to build instance.
Oct 26 17:04:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-171bcc29-eddb-41f6-96a7-d2ff9faccffa tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "870b7db3-6425-4596-a942-736eccf07ebd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.950s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-d970a794-0256-4456-a82c-a3b81893e95a req-60b77d62-c1ad-4680-a2d8-dd2de159e7b3 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:04:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d970a794-0256-4456-a82c-a3b81893e95a req-60b77d62-c1ad-4680-a2d8-dd2de159e7b3 service nova] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:04:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d970a794-0256-4456-a82c-a3b81893e95a req-60b77d62-c1ad-4680-a2d8-dd2de159e7b3 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:04:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d970a794-0256-4456-a82c-a3b81893e95a req-60b77d62-c1ad-4680-a2d8-dd2de159e7b3 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:04:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-d970a794-0256-4456-a82c-a3b81893e95a req-60b77d62-c1ad-4680-a2d8-dd2de159e7b3 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] No waiting events found dispatching network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:04:59 user nova-compute[75113]: WARNING nova.compute.manager [req-d970a794-0256-4456-a82c-a3b81893e95a req-60b77d62-c1ad-4680-a2d8-dd2de159e7b3 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received unexpected event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c for instance with vm_state active and task_state rescuing.
Oct 26 17:04:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:04:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:05:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:00 user nova-compute[75113]: INFO nova.compute.manager [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Terminating instance
Oct 26 17:05:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:05:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-c31fda34-04f4-48a6-8bfc-fd35a011d543 req-4f7355dd-918a-4294-a639-b45b48683a3b service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-vif-unplugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c31fda34-04f4-48a6-8bfc-fd35a011d543 req-4f7355dd-918a-4294-a639-b45b48683a3b service nova] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c31fda34-04f4-48a6-8bfc-fd35a011d543 req-4f7355dd-918a-4294-a639-b45b48683a3b service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c31fda34-04f4-48a6-8bfc-fd35a011d543 req-4f7355dd-918a-4294-a639-b45b48683a3b service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-c31fda34-04f4-48a6-8bfc-fd35a011d543 req-4f7355dd-918a-4294-a639-b45b48683a3b service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] No waiting events found dispatching network-vif-unplugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-c31fda34-04f4-48a6-8bfc-fd35a011d543 req-4f7355dd-918a-4294-a639-b45b48683a3b service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-vif-unplugged-ff980165-116a-431e-90a0-3a1d98b79b9d for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-f2331355-5e01-4144-89f0-ce08b9a770b6 req-ef5bb2d5-9eb3-421b-a3fb-5670b4953178 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f2331355-5e01-4144-89f0-ce08b9a770b6 req-ef5bb2d5-9eb3-421b-a3fb-5670b4953178 service nova] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f2331355-5e01-4144-89f0-ce08b9a770b6 req-ef5bb2d5-9eb3-421b-a3fb-5670b4953178 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f2331355-5e01-4144-89f0-ce08b9a770b6 req-ef5bb2d5-9eb3-421b-a3fb-5670b4953178 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-f2331355-5e01-4144-89f0-ce08b9a770b6 req-ef5bb2d5-9eb3-421b-a3fb-5670b4953178 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] No waiting events found dispatching network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:01 user nova-compute[75113]: WARNING nova.compute.manager [req-f2331355-5e01-4144-89f0-ce08b9a770b6 req-ef5bb2d5-9eb3-421b-a3fb-5670b4953178 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received unexpected event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c for instance with vm_state active and task_state rescuing.
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-f2331355-5e01-4144-89f0-ce08b9a770b6 req-ef5bb2d5-9eb3-421b-a3fb-5670b4953178 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f2331355-5e01-4144-89f0-ce08b9a770b6 req-ef5bb2d5-9eb3-421b-a3fb-5670b4953178 service nova] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f2331355-5e01-4144-89f0-ce08b9a770b6 req-ef5bb2d5-9eb3-421b-a3fb-5670b4953178 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f2331355-5e01-4144-89f0-ce08b9a770b6 req-ef5bb2d5-9eb3-421b-a3fb-5670b4953178 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-f2331355-5e01-4144-89f0-ce08b9a770b6 req-ef5bb2d5-9eb3-421b-a3fb-5670b4953178 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] No waiting events found dispatching network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:01 user nova-compute[75113]: WARNING nova.compute.manager [req-f2331355-5e01-4144-89f0-ce08b9a770b6 req-ef5bb2d5-9eb3-421b-a3fb-5670b4953178 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received unexpected event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c for instance with vm_state active and task_state rescuing.
Oct 26 17:05:01 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Skipping network cache update for instance because it is being deleted. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 04f0351c-6347-4353-bc70-ffa74158496c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:01 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Instance destroyed successfully.
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.objects.instance [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'resources' on Instance uuid 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1982662822',display_name='tempest-TestMinimumBasicScenario-server-1982662822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1982662822',id=15,image_ref='0521c00f-82dc-45d4-8764-d12668ce2240',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9WGXEXrBv1HHrw/BahosIMiFehiyfTzuTP5JS60S6ifc+z3JAckDUJ8DH1IMfHJttIi9rYDvL4URf4GCDY6zxa1JU9fTzpckEU87gTgbFD+aLdpBaRRzDKuYiuSf0lnQ==',key_name='tempest-TestMinimumBasicScenario-1651364451',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:59:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd0d356ed9284735abb524c73c143e3b',ramdisk_id='',reservation_id='r-4nvn6z1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0521c00f-82dc-45d4-8764-d12668ce2240',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1757884343',owner_user_name='tempest-TestMinimumBasicScenario-1757884343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:02:14Z,user_data=None,user_id='25d708e692104c63ac2e25531e82d734',uuid=57a1b1df-ced1-4df2-8714-9aaa5f3c7e36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converting VIF {"id": "ff980165-116a-431e-90a0-3a1d98b79b9d", "address": "fa:16:3e:e8:74:98", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff980165-11", "ovs_interfaceid": "ff980165-116a-431e-90a0-3a1d98b79b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG os_vif [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff980165-11, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6475b017-fd81-4a64-b1ad-c97fd2006902) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:05:01 user nova-compute[75113]: INFO os_vif [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:74:98,bridge_name='br-int',has_traffic_filtering=True,id=ff980165-116a-431e-90a0-3a1d98b79b9d,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff980165-11')
Oct 26 17:05:01 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Deleting instance files /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36_del
Oct 26 17:05:01 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Deletion of /opt/stack/data/nova/instances/57a1b1df-ced1-4df2-8714-9aaa5f3c7e36_del complete
Oct 26 17:05:01 user nova-compute[75113]: INFO nova.compute.manager [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Took 1.12 seconds to destroy the instance on the hypervisor.
Oct 26 17:05:01 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:05:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-853892c9-1a67-4e01-82ad-0199db64ff50 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:05:02 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Updating instance_info_cache with network_info: [{"id": "de147975-aa0e-4028-af5f-a92993f17b8f", "address": "fa:16:3e:47:99:24", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde147975-aa", "ovs_interfaceid": "de147975-aa0e-4028-af5f-a92993f17b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:05:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:05:02 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:05:02 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:05:02 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:05:02 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 17:05:02 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:05:02 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Took 0.58 seconds to deallocate network for instance.
Oct 26 17:05:02 user nova-compute[75113]: DEBUG nova.compute.manager [req-9a375012-f5e3-4490-a938-6aa5cabe13b2 req-e26fccda-aff4-4564-85a0-8a71120be635 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-vif-deleted-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:02 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:05:02 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:05:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:03 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Deleted allocations for instance 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36
Oct 26 17:05:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-886e12dd-3a4d-4e0a-b3bf-44b0e55ec3e5 req-4367bc75-051d-485f-a4ca-5dbfd8745384 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received event network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-886e12dd-3a4d-4e0a-b3bf-44b0e55ec3e5 req-4367bc75-051d-485f-a4ca-5dbfd8745384 service nova] Acquiring lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-886e12dd-3a4d-4e0a-b3bf-44b0e55ec3e5 req-4367bc75-051d-485f-a4ca-5dbfd8745384 service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-886e12dd-3a4d-4e0a-b3bf-44b0e55ec3e5 req-4367bc75-051d-485f-a4ca-5dbfd8745384 service nova] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-886e12dd-3a4d-4e0a-b3bf-44b0e55ec3e5 req-4367bc75-051d-485f-a4ca-5dbfd8745384 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] No waiting events found dispatching network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:03 user nova-compute[75113]: WARNING nova.compute.manager [req-886e12dd-3a4d-4e0a-b3bf-44b0e55ec3e5 req-4367bc75-051d-485f-a4ca-5dbfd8745384 service nova] [instance: 57a1b1df-ced1-4df2-8714-9aaa5f3c7e36] Received unexpected event network-vif-plugged-ff980165-116a-431e-90a0-3a1d98b79b9d for instance with vm_state deleted and task_state None.
Oct 26 17:05:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ff2825fb-85d2-4818-ae54-b7bb050c2208 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "57a1b1df-ced1-4df2-8714-9aaa5f3c7e36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.485s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:04 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:05:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:05:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:05:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:05 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:05:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:05:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:05:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:05:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:10 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:05:10 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:05:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7451MB free_disk=25.15460968017578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:05:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 37683519-d90a-4fa4-8e8f-cc883a2573ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 870b7db3-6425-4596-a942-736eccf07ebd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing inventories for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating ProviderTree inventory for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating inventory in ProviderTree for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing aggregate associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, aggregates: None {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing trait associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.971s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 17:05:11 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] There are 0 instances to clean {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 17:05:13 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:05:13 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:05:13 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:05:13 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGlxPWFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:05:15 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:05:15 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:05:15 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f2f3af-36f9-45a1-9898-fd2e87e2bbaa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:05:15 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d166140-c45f-4ae3-be0b-2d93a29d3ecf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804] added
Oct 26 17:05:15 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece70def-9829-4825-9f44-7eb06ee1163a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b388e7-34be-469c-ab8d-7197eaa68c29]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZGlxPWFs {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZGlxPWFs" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[28059492-643c-43d5-a0e0-ff7172c322b9]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZGlxPWFs'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[672ac602-927b-4a77-a255-26d521a8a080]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e39011-d422-4614-ab42-167fca78e888]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:15 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:05:15 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:15 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:15 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:05:15 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:15 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5378113-add3-4ca6-a60b-2fa52a34ff4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260]
Oct 26 17:05:15 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260] successful.
Oct 26 17:05:15 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a0cc4c-6e10-464b-96db-c8446d5f8b88]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cb99e0-70a5-45fe-9992-bcac2e3da19b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:15 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:05:15 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:15 user nova-compute[75113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:05:15 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:15 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:05:15 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:15 user nova-compute[75113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:05:15 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c6830d-3b40-4487-a0c7-9263f505076e]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:05:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGlxPWFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:05:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:05:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23135333334303337', 'path': '/dev/sde'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:05:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135333334303337', 'path': '/dev/sde'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:05:16 user nova-compute[75113]: DEBUG nova.objects.instance [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lazy-loading 'flavor' on Instance uuid b07d5f6f-8994-46a8-8c80-c0b803c894b0 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:05:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:05:16 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:05:16 user nova-compute[75113]:   <source dev="/dev/sde"/>
Oct 26 17:05:16 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:05:16 user nova-compute[75113]:   <serial>7528c15d-6770-43f0-b1dc-705e7d29f804</serial>
Oct 26 17:05:16 user nova-compute[75113]: </disk>
Oct 26 17:05:16 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:05:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:05:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:05:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No VIF found with MAC fa:16:3e:ab:4a:42, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:05:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e3664454-dffb-4829-a6b1-72ae173805b0 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.370s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:19 user nova-compute[75113]: INFO nova.compute.manager [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Rebuilding instance
Oct 26 17:05:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:05:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-fbe2a8fc-f6e1-4971-9b83-1b005dca72f2 req-556cc712-6c41-483a-a479-06f17d9af565 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received event network-vif-unplugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fbe2a8fc-f6e1-4971-9b83-1b005dca72f2 req-556cc712-6c41-483a-a479-06f17d9af565 service nova] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fbe2a8fc-f6e1-4971-9b83-1b005dca72f2 req-556cc712-6c41-483a-a479-06f17d9af565 service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fbe2a8fc-f6e1-4971-9b83-1b005dca72f2 req-556cc712-6c41-483a-a479-06f17d9af565 service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-fbe2a8fc-f6e1-4971-9b83-1b005dca72f2 req-556cc712-6c41-483a-a479-06f17d9af565 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] No waiting events found dispatching network-vif-unplugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:19 user nova-compute[75113]: WARNING nova.compute.manager [req-fbe2a8fc-f6e1-4971-9b83-1b005dca72f2 req-556cc712-6c41-483a-a479-06f17d9af565 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received unexpected event network-vif-unplugged-e8551569-369f-4dfc-a57e-c1c06ed135bf for instance with vm_state active and task_state rebuilding.
Oct 26 17:05:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:20 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Instance destroyed successfully.
Oct 26 17:05:20 user nova-compute[75113]: INFO nova.compute.manager [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Detaching volume 7528c15d-6770-43f0-b1dc-705e7d29f804
Oct 26 17:05:20 user nova-compute[75113]: INFO nova.virt.block_device [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Attempting to driver detach volume 7528c15d-6770-43f0-b1dc-705e7d29f804 from mountpoint /dev/vdb
Oct 26 17:05:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Attempting to detach device vdb from instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:05:20 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:05:20 user nova-compute[75113]:   <source dev="/dev/sde"/>
Oct 26 17:05:20 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:05:20 user nova-compute[75113]:   <serial>7528c15d-6770-43f0-b1dc-705e7d29f804</serial>
Oct 26 17:05:20 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:05:20 user nova-compute[75113]: </disk>
Oct 26 17:05:20 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:05:20 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Successfully detached device vdb from instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 from the persistent domain config.
Oct 26 17:05:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGlxPWFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:05:20 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[079bc5da-29b8-4d6f-ae1b-7cf2de99ae6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:05:20 user nova-compute[75113]: No targets found.
Oct 26 17:05:20 user nova-compute[75113]: iSNS:
Oct 26 17:05:20 user nova-compute[75113]: No targets found.
Oct 26 17:05:20 user nova-compute[75113]: STATIC:
Oct 26 17:05:20 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804
Oct 26 17:05:20 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:05:20 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:05:20 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:05:20 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:05:20 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:05:20 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322
Oct 26 17:05:20 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:05:20 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:05:20 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24
Oct 26 17:05:20 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:05:20 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:05:20 user nova-compute[75113]: FIRMWARE:
Oct 26 17:05:20 user nova-compute[75113]: No targets found.
Oct 26 17:05:20 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:05:20 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:05:20 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e01409e-9c19-45c7-a556-acb89c0319c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5391f190-1d64-4b87-bb6c-be19969356c7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:20 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:05:20 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:20 user nova-compute[75113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:05:20 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:20 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:05:20 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:20 user nova-compute[75113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:05:20 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914234820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804'): ({'sde'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Removing single pathed devices sde {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b5222d-cd62-43cc-8ae7-8dd4b5a49280]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8784f101-dff2-4c10-810d-779cbebb166b]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flushing IO for device /dev/sde {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1829e5-1922-4c1b-933b-b2890d60484b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b856c3-d4dd-407c-b354-aeb9c1db73bd]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ee2ed5-8361-49f1-aee2-29f22f435258]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c59536-45c0-47c1-88e7-707e1c75fb7e]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260]
Oct 26 17:05:20 user nova-compute[75113]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260] successful.
Oct 26 17:05:20 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cec1d3-75dd-4690-935c-6631b77cc127]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] <== disconnect_volume: return (322ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:05:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-1e0df9eb-860e-44c0-bbed-db4babddaac3 req-7f3b408b-c72b-4f78-aee0-59e53d8b88cf service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received event network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1e0df9eb-860e-44c0-bbed-db4babddaac3 req-7f3b408b-c72b-4f78-aee0-59e53d8b88cf service nova] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1e0df9eb-860e-44c0-bbed-db4babddaac3 req-7f3b408b-c72b-4f78-aee0-59e53d8b88cf service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1e0df9eb-860e-44c0-bbed-db4babddaac3 req-7f3b408b-c72b-4f78-aee0-59e53d8b88cf service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-1e0df9eb-860e-44c0-bbed-db4babddaac3 req-7f3b408b-c72b-4f78-aee0-59e53d8b88cf service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] No waiting events found dispatching network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:21 user nova-compute[75113]: WARNING nova.compute.manager [req-1e0df9eb-860e-44c0-bbed-db4babddaac3 req-7f3b408b-c72b-4f78-aee0-59e53d8b88cf service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received unexpected event network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf for instance with vm_state active and task_state rebuilding.
Oct 26 17:05:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:21 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Instance destroyed successfully.
Oct 26 17:05:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-344642576',display_name='tempest-ServerActionsTestOtherA-server-1923697164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-344642576',id=21,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKDgMEMkpFlH8KZx6RrwYwMvXxYdxXkahHL23zoh9+5s6eqdjgg+Ebr255x4MvsxDhjqzswkbnJBfDeEKclFqpSIgvgAFmGk/YzRnMisxnzZSlJhLo3ijX43KEIBuel7A==',key_name='tempest-keypair-1377389928',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:03:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-hpcm4pye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=b07d5f6f-8994-46a8-8c80-c0b803c894b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG os_vif [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8551569-36, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58689f77-2cce-42fe-87c9-bc9dfb308d62) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:21 user nova-compute[75113]: INFO os_vif [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36')
Oct 26 17:05:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGlxPWFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:05:21 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 17:05:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[620e94a4-b2f7-4474-afa0-3d49fdd409e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:05:21 user nova-compute[75113]: No targets found.
Oct 26 17:05:21 user nova-compute[75113]: iSNS:
Oct 26 17:05:21 user nova-compute[75113]: No targets found.
Oct 26 17:05:21 user nova-compute[75113]: STATIC:
Oct 26 17:05:21 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:05:21 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:05:21 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:05:21 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322
Oct 26 17:05:21 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:05:21 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:05:21 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24
Oct 26 17:05:21 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:05:21 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:05:21 user nova-compute[75113]: FIRMWARE:
Oct 26 17:05:21 user nova-compute[75113]: No targets found.
Oct 26 17:05:21 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:05:21 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:05:21 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c443ef24-653c-4fd6-848d-d387113aee1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6676a68-8ead-4a1c-96f1-8fab0f140c2f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:21 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:05:21 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:21 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:21 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:05:21 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:21 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49143567a0>, {}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Disconnecting from: [] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] <== disconnect_volume: return (77ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:05:21 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:05:21 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Deleting instance files /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0_del
Oct 26 17:05:21 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Deletion of /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0_del complete
Oct 26 17:05:21 user nova-compute[75113]: INFO nova.virt.block_device [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Booting with volume 7528c15d-6770-43f0-b1dc-705e7d29f804 at /dev/vdb
Oct 26 17:05:22 user nova-compute[75113]: DEBUG os_brick.utils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ce7c64-6245-4017-a875-07924cf6e042]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0551e5b4-eaa8-47cf-ad43-25b727d4173a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0e1ca2-3f2e-469a-a4af-cc9ac614efda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a228cd57-d620-4169-9331-23430afe22d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:05:22 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:05:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be82c0a-aa34-4ab3-ae1d-7fa75ecfe576]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG os_brick.utils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:05:22 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Updating existing volume attachment record: d4b29cfa-a201-48c1-9f55-4e59a254a2ae {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:05:23 user nova-compute[75113]: DEBUG nova.compute.manager [req-899a8300-2704-4eba-a102-3f5de9ad88ac req-30863d34-2fab-4005-a94a-54a26ac27704 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received event network-changed-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:23 user nova-compute[75113]: DEBUG nova.compute.manager [req-899a8300-2704-4eba-a102-3f5de9ad88ac req-30863d34-2fab-4005-a94a-54a26ac27704 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Refreshing instance network info cache due to event network-changed-d7e20a2e-c0b5-4551-bc13-e3ef233eae81. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:05:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-899a8300-2704-4eba-a102-3f5de9ad88ac req-30863d34-2fab-4005-a94a-54a26ac27704 service nova] Acquiring lock "refresh_cache-37683519-d90a-4fa4-8e8f-cc883a2573ac" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:05:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-899a8300-2704-4eba-a102-3f5de9ad88ac req-30863d34-2fab-4005-a94a-54a26ac27704 service nova] Acquired lock "refresh_cache-37683519-d90a-4fa4-8e8f-cc883a2573ac" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:05:23 user nova-compute[75113]: DEBUG nova.network.neutron [req-899a8300-2704-4eba-a102-3f5de9ad88ac req-30863d34-2fab-4005-a94a-54a26ac27704 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Refreshing network info cache for port d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:05:24 user nova-compute[75113]: DEBUG nova.network.neutron [req-899a8300-2704-4eba-a102-3f5de9ad88ac req-30863d34-2fab-4005-a94a-54a26ac27704 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Updated VIF entry in instance network info cache for port d7e20a2e-c0b5-4551-bc13-e3ef233eae81. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:05:24 user nova-compute[75113]: DEBUG nova.network.neutron [req-899a8300-2704-4eba-a102-3f5de9ad88ac req-30863d34-2fab-4005-a94a-54a26ac27704 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Updating instance_info_cache with network_info: [{"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:05:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-899a8300-2704-4eba-a102-3f5de9ad88ac req-30863d34-2fab-4005-a94a-54a26ac27704 service nova] Releasing lock "refresh_cache-37683519-d90a-4fa4-8e8f-cc883a2573ac" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:05:25 user nova-compute[75113]: INFO nova.compute.manager [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Rebuilding instance
Oct 26 17:05:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:05:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-c71325eb-1cb2-4474-b867-adbe7f40ee38 req-a1d9f043-dcad-4939-a647-cb72f5bae649 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received event network-vif-unplugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c71325eb-1cb2-4474-b867-adbe7f40ee38 req-a1d9f043-dcad-4939-a647-cb72f5bae649 service nova] Acquiring lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c71325eb-1cb2-4474-b867-adbe7f40ee38 req-a1d9f043-dcad-4939-a647-cb72f5bae649 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c71325eb-1cb2-4474-b867-adbe7f40ee38 req-a1d9f043-dcad-4939-a647-cb72f5bae649 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-c71325eb-1cb2-4474-b867-adbe7f40ee38 req-a1d9f043-dcad-4939-a647-cb72f5bae649 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] No waiting events found dispatching network-vif-unplugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:25 user nova-compute[75113]: WARNING nova.compute.manager [req-c71325eb-1cb2-4474-b867-adbe7f40ee38 req-a1d9f043-dcad-4939-a647-cb72f5bae649 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received unexpected event network-vif-unplugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 for instance with vm_state active and task_state rebuilding.
Oct 26 17:05:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:26 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Instance destroyed successfully.
Oct 26 17:05:26 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Instance destroyed successfully.
Oct 26 17:05:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-208554010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1698414037',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdPVR8jrmmvs+FA1zsu8BhsOGQFKaF3g3dbAYbTOUQUphGdHDb5ZBl+LTAW9kwLngnlZjZt/Fup1ZMGDest0Syvi7iB20PUTksvIR3dTjbbM0POZ2eFVo0aHjgMG+Kq4A==',key_name='tempest-keypair-352373129',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e3ef36922d4fb7902344a5e66d9941',ramdisk_id='',reservation_id='r-vdp0td0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1360395865',owner_user_name='tempest-ServerActionsV293TestJSON-1360395865-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9de31526e7d049c0933bd981347ad67b',uuid=37683519-d90a-4fa4-8e8f-cc883a2573ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Converting VIF {"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_vif [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7e20a2e-c0, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6186074-5b0a-4410-9abe-4165124bc10d) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:05:26 user nova-compute[75113]: INFO os_vif [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0')
Oct 26 17:05:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNKpJYag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:05:26 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b208885-d8de-4069-a218-54d10a3f1e19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:05:26 user nova-compute[75113]: No targets found.
Oct 26 17:05:26 user nova-compute[75113]: iSNS:
Oct 26 17:05:26 user nova-compute[75113]: No targets found.
Oct 26 17:05:26 user nova-compute[75113]: STATIC:
Oct 26 17:05:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:05:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:05:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:05:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322
Oct 26 17:05:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:05:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:05:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24
Oct 26 17:05:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:05:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:05:26 user nova-compute[75113]: FIRMWARE:
Oct 26 17:05:26 user nova-compute[75113]: No targets found.
Oct 26 17:05:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:05:26 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:05:26 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[357f2196-236a-4aa2-b2c9-302ed3f42eb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cea9125-f909-41fc-8ba1-913b280743a3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:26 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:05:26 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:26 user nova-compute[75113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:05:26 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914145ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad1f73d-1134-4b40-8e2a-d2f5b22c1771]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46da283-519d-4df4-802e-db5d8e752c51]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1360d0cc-f64a-46ac-a356-5529cf1cd1e6]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e65d1aa-79e7-46ca-abee-ac6aa914b00f]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf9bf757c-79521f2b2076522e', '/dev/disk/by-id/scsi-23739353231663262', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f9bf757c') {{(pid=86603) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34749a39-fff3-4aea-9f75-931cf42bb7c2]: (4, None) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e7fe63-cd1b-4b6c-b7db-476117fcc72e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec417bd9-85d6-4910-a420-21f198558930]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260]
Oct 26 17:05:26 user nova-compute[75113]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260] successful.
Oct 26 17:05:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca5219a-1416-47c7-bc3d-933a6f9683ca]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] <== disconnect_volume: return (349ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:05:26 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Deleting instance files /opt/stack/data/nova/instances/37683519-d90a-4fa4-8e8f-cc883a2573ac_del
Oct 26 17:05:26 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Deletion of /opt/stack/data/nova/instances/37683519-d90a-4fa4-8e8f-cc883a2573ac_del complete
Oct 26 17:05:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:26 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 37683519-d90a-4fa4-8e8f-cc883a2573ac could not be found.
Oct 26 17:05:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNKpJYag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:05:26 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[84057a7d-21cd-4df5-bc47-4d3aaa89e1e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:05:26 user nova-compute[75113]: No targets found.
Oct 26 17:05:26 user nova-compute[75113]: iSNS:
Oct 26 17:05:26 user nova-compute[75113]: No targets found.
Oct 26 17:05:26 user nova-compute[75113]: STATIC:
Oct 26 17:05:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:05:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:05:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:05:26 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322
Oct 26 17:05:26 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:05:26 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:05:26 user nova-compute[75113]: FIRMWARE:
Oct 26 17:05:26 user nova-compute[75113]: No targets found.
Oct 26 17:05:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:05:26 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:05:26 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab0ee3b-a2b5-43e2-9c4a-7b1ca3198d99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d63699-7ef4-4772-8fb6-93ff840d676d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:26 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:26 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:26 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49143e4c10>, {}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Disconnecting from: [] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] <== disconnect_volume: return (78ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:05:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:05:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-5730078e-47a3-48a9-af2c-8ff0f0ed52db req-9fc73e5c-eac5-4123-902d-4a4a0634a442 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received event network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5730078e-47a3-48a9-af2c-8ff0f0ed52db req-9fc73e5c-eac5-4123-902d-4a4a0634a442 service nova] Acquiring lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5730078e-47a3-48a9-af2c-8ff0f0ed52db req-9fc73e5c-eac5-4123-902d-4a4a0634a442 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5730078e-47a3-48a9-af2c-8ff0f0ed52db req-9fc73e5c-eac5-4123-902d-4a4a0634a442 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-5730078e-47a3-48a9-af2c-8ff0f0ed52db req-9fc73e5c-eac5-4123-902d-4a4a0634a442 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] No waiting events found dispatching network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:27 user nova-compute[75113]: WARNING nova.compute.manager [req-5730078e-47a3-48a9-af2c-8ff0f0ed52db req-9fc73e5c-eac5-4123-902d-4a4a0634a442 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received unexpected event network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 for instance with vm_state active and task_state rebuilding.
Oct 26 17:05:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Preparing to wait for external event volume-reimaged-c2de619a-4ee3-47dd-8780-dd158767fe24 {{(pid=75113) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 26 17:05:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:05:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Creating image(s)
Oct 26 17:05:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "/opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "/opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "/opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.207s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk 1073741824" returned: 0 in 0.050s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.250s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Cannot resize image /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Ensure instance console log exists: /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Start _get_guest_xml network_info=[{"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd4b29cfa-a201-48c1-9f55-4e59a254a2ae', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGlxPWFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b07d5f6f-8994-46a8-8c80-c0b803c894b0', 'attached_at': '', 'detached_at': '', 'volume_id': '7528c15d-6770-43f0-b1dc-705e7d29f804', 'serial': '7528c15d-6770-43f0-b1dc-705e7d29f804'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:05:43 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 17:05:43 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.objects.instance [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lazy-loading 'vcpu_model' on Instance uuid b07d5f6f-8994-46a8-8c80-c0b803c894b0 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGlxPWFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:05:43 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 17:05:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:05:43 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 17:05:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:05:43 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de1dccd-13d3-4716-b2fc-59f8a257551e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:05:43 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[572145d0-ba59-46a5-9b23-f04bc8756583]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804] added
Oct 26 17:05:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[67908918-9ec9-4a48-b276-8a64ba400ef9]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf0c5d6-24eb-4202-a679-caaf5289fd83]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZGlxPWFs {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZGlxPWFs" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4a334b-070b-42aa-a774-2d520e0c19b8]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZGlxPWFs'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[595b4b53-e0a0-4bf7-a63f-7b64787187a8]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be70e61-9bc1-495e-a25b-abadff7cd5e0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:43 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:43 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:05:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[92038b58-6af3-4f5b-94fa-55dffd10bb9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260]
Oct 26 17:05:44 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260] successful.
Oct 26 17:05:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df7ff36-9c68-474d-b0f2-988f4a4e6e10]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5f17e1-d48d-4072-8ba9-fc11beb7a02d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:44 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:44 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:05:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:05:44 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:05:44 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:05:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb34eac9-05f9-4689-8599-72a6f1ba811a]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:05:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGlxPWFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23135333334303337', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135333334303337', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-344642576',display_name='tempest-ServerActionsTestOtherA-server-1923697164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-344642576',id=21,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKDgMEMkpFlH8KZx6RrwYwMvXxYdxXkahHL23zoh9+5s6eqdjgg+Ebr255x4MvsxDhjqzswkbnJBfDeEKclFqpSIgvgAFmGk/YzRnMisxnzZSlJhLo3ijX43KEIBuel7A==',key_name='tempest-keypair-1377389928',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:03:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-hpcm4pye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:05:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=b07d5f6f-8994-46a8-8c80-c0b803c894b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:05:45 user nova-compute[75113]:   <uuid>b07d5f6f-8994-46a8-8c80-c0b803c894b0</uuid>
Oct 26 17:05:45 user nova-compute[75113]:   <name>instance-00000015</name>
Oct 26 17:05:45 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:05:45 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:05:45 user nova-compute[75113]:   <metadata>
Oct 26 17:05:45 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:05:45 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:05:45 user nova-compute[75113]:       <nova:name>tempest-ServerActionsTestOtherA-server-1923697164</nova:name>
Oct 26 17:05:45 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:05:43</nova:creationTime>
Oct 26 17:05:45 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:05:45 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:05:45 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:05:45 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:05:45 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:05:45 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:05:45 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:05:45 user nova-compute[75113]:       <nova:owner>
Oct 26 17:05:45 user nova-compute[75113]:         <nova:user uuid="be611f9c83184dc29d232904a828b12a">tempest-ServerActionsTestOtherA-2074512325-project-member</nova:user>
Oct 26 17:05:45 user nova-compute[75113]:         <nova:project uuid="5e63bbd8ed7e4fc189d54c828d43e445">tempest-ServerActionsTestOtherA-2074512325</nova:project>
Oct 26 17:05:45 user nova-compute[75113]:       </nova:owner>
Oct 26 17:05:45 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:05:45 user nova-compute[75113]:       <nova:ports>
Oct 26 17:05:45 user nova-compute[75113]:         <nova:port uuid="e8551569-369f-4dfc-a57e-c1c06ed135bf">
Oct 26 17:05:45 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 17:05:45 user nova-compute[75113]:         </nova:port>
Oct 26 17:05:45 user nova-compute[75113]:       </nova:ports>
Oct 26 17:05:45 user nova-compute[75113]:     </nova:instance>
Oct 26 17:05:45 user nova-compute[75113]:   </metadata>
Oct 26 17:05:45 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:05:45 user nova-compute[75113]:     <system>
Oct 26 17:05:45 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:05:45 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:05:45 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:05:45 user nova-compute[75113]:       <entry name="serial">b07d5f6f-8994-46a8-8c80-c0b803c894b0</entry>
Oct 26 17:05:45 user nova-compute[75113]:       <entry name="uuid">b07d5f6f-8994-46a8-8c80-c0b803c894b0</entry>
Oct 26 17:05:45 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:05:45 user nova-compute[75113]:     </system>
Oct 26 17:05:45 user nova-compute[75113]:   </sysinfo>
Oct 26 17:05:45 user nova-compute[75113]:   <os>
Oct 26 17:05:45 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:05:45 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:05:45 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:05:45 user nova-compute[75113]:   </os>
Oct 26 17:05:45 user nova-compute[75113]:   <features>
Oct 26 17:05:45 user nova-compute[75113]:     <acpi/>
Oct 26 17:05:45 user nova-compute[75113]:     <apic/>
Oct 26 17:05:45 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:05:45 user nova-compute[75113]:   </features>
Oct 26 17:05:45 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:05:45 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:05:45 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:05:45 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:05:45 user nova-compute[75113]:   </clock>
Oct 26 17:05:45 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:05:45 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:05:45 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:05:45 user nova-compute[75113]:   </cpu>
Oct 26 17:05:45 user nova-compute[75113]:   <devices>
Oct 26 17:05:45 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:05:45 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:05:45 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk"/>
Oct 26 17:05:45 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:05:45 user nova-compute[75113]:     </disk>
Oct 26 17:05:45 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:05:45 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:05:45 user nova-compute[75113]:       <source dev="/dev/sdb"/>
Oct 26 17:05:45 user nova-compute[75113]:       <target dev="vdb" bus="virtio"/>
Oct 26 17:05:45 user nova-compute[75113]:       <serial>7528c15d-6770-43f0-b1dc-705e7d29f804</serial>
Oct 26 17:05:45 user nova-compute[75113]:     </disk>
Oct 26 17:05:45 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:05:45 user nova-compute[75113]:       <mac address="fa:16:3e:ab:4a:42"/>
Oct 26 17:05:45 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:05:45 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:05:45 user nova-compute[75113]:       <target dev="tape8551569-36"/>
Oct 26 17:05:45 user nova-compute[75113]:     </interface>
Oct 26 17:05:45 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:05:45 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/console.log" append="off"/>
Oct 26 17:05:45 user nova-compute[75113]:     </serial>
Oct 26 17:05:45 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:05:45 user nova-compute[75113]:     <video>
Oct 26 17:05:45 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:05:45 user nova-compute[75113]:     </video>
Oct 26 17:05:45 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:05:45 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:05:45 user nova-compute[75113]:     </rng>
Oct 26 17:05:45 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:05:45 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:05:45 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:05:45 user nova-compute[75113]:     </memballoon>
Oct 26 17:05:45 user nova-compute[75113]:   </devices>
Oct 26 17:05:45 user nova-compute[75113]: </domain>
Oct 26 17:05:45 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-344642576',display_name='tempest-ServerActionsTestOtherA-server-1923697164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-344642576',id=21,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKDgMEMkpFlH8KZx6RrwYwMvXxYdxXkahHL23zoh9+5s6eqdjgg+Ebr255x4MvsxDhjqzswkbnJBfDeEKclFqpSIgvgAFmGk/YzRnMisxnzZSlJhLo3ijX43KEIBuel7A==',key_name='tempest-keypair-1377389928',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:03:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-hpcm4pye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:05:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=b07d5f6f-8994-46a8-8c80-c0b803c894b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG os_vif [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ca800d6-9c37-5e05-817c-2dac2bb43bab', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8551569-36, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8551569-36, col_values=(('qos', UUID('9fd63a37-0ef9-43a7-b265-2f1188c72600')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8551569-36, col_values=(('external_ids', {'iface-id': 'e8551569-369f-4dfc-a57e-c1c06ed135bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:4a:42', 'vm-uuid': 'b07d5f6f-8994-46a8-8c80-c0b803c894b0'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:45 user nova-compute[75113]: INFO os_vif [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36')
Oct 26 17:05:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:05:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No VIF found with MAC fa:16:3e:ab:4a:42, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:05:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-2b377846-c767-4591-a658-ef359a796766 req-cac87b8e-ace0-48f7-9676-bc9735d5543c service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received event network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b377846-c767-4591-a658-ef359a796766 req-cac87b8e-ace0-48f7-9676-bc9735d5543c service nova] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b377846-c767-4591-a658-ef359a796766 req-cac87b8e-ace0-48f7-9676-bc9735d5543c service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2b377846-c767-4591-a658-ef359a796766 req-cac87b8e-ace0-48f7-9676-bc9735d5543c service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-2b377846-c767-4591-a658-ef359a796766 req-cac87b8e-ace0-48f7-9676-bc9735d5543c service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] No waiting events found dispatching network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:47 user nova-compute[75113]: WARNING nova.compute.manager [req-2b377846-c767-4591-a658-ef359a796766 req-cac87b8e-ace0-48f7-9676-bc9735d5543c service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received unexpected event network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf for instance with vm_state active and task_state rebuild_spawning.
Oct 26 17:05:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:05:49 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Instance spawned successfully.
Oct 26 17:05:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-4a10ca6c-d136-4352-9e97-5c1f8ddb83c1 req-0397a5ba-7a0f-4348-9693-46ea8af1647c service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received event network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4a10ca6c-d136-4352-9e97-5c1f8ddb83c1 req-0397a5ba-7a0f-4348-9693-46ea8af1647c service nova] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4a10ca6c-d136-4352-9e97-5c1f8ddb83c1 req-0397a5ba-7a0f-4348-9693-46ea8af1647c service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4a10ca6c-d136-4352-9e97-5c1f8ddb83c1 req-0397a5ba-7a0f-4348-9693-46ea8af1647c service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-4a10ca6c-d136-4352-9e97-5c1f8ddb83c1 req-0397a5ba-7a0f-4348-9693-46ea8af1647c service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] No waiting events found dispatching network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:49 user nova-compute[75113]: WARNING nova.compute.manager [req-4a10ca6c-d136-4352-9e97-5c1f8ddb83c1 req-0397a5ba-7a0f-4348-9693-46ea8af1647c service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received unexpected event network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf for instance with vm_state active and task_state rebuild_spawning.
Oct 26 17:05:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG nova.objects.instance [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75113) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 26 17:05:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-48a2fc21-a8e0-40ad-9c1b-70191cc3aae4 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.105s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:52 user nova-compute[75113]: INFO nova.compute.manager [None req-5bcdfbd2-2b1a-4a46-bddf-68f218e6ad1c tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Unrescuing
Oct 26 17:05:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5bcdfbd2-2b1a-4a46-bddf-68f218e6ad1c tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:05:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5bcdfbd2-2b1a-4a46-bddf-68f218e6ad1c tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquired lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:05:52 user nova-compute[75113]: DEBUG nova.network.neutron [None req-5bcdfbd2-2b1a-4a46-bddf-68f218e6ad1c tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:05:52 user nova-compute[75113]: DEBUG nova.network.neutron [None req-5bcdfbd2-2b1a-4a46-bddf-68f218e6ad1c tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Updating instance_info_cache with network_info: [{"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:05:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5bcdfbd2-2b1a-4a46-bddf-68f218e6ad1c tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Releasing lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:05:52 user nova-compute[75113]: DEBUG nova.objects.instance [None req-5bcdfbd2-2b1a-4a46-bddf-68f218e6ad1c tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'flavor' on Instance uuid 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:05:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-4220eeb1-7bef-4fef-948c-94147ca042af req-872e5e72-155e-4f55-b5c6-2fb85c5eb8f1 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-unplugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4220eeb1-7bef-4fef-948c-94147ca042af req-872e5e72-155e-4f55-b5c6-2fb85c5eb8f1 service nova] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4220eeb1-7bef-4fef-948c-94147ca042af req-872e5e72-155e-4f55-b5c6-2fb85c5eb8f1 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4220eeb1-7bef-4fef-948c-94147ca042af req-872e5e72-155e-4f55-b5c6-2fb85c5eb8f1 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-4220eeb1-7bef-4fef-948c-94147ca042af req-872e5e72-155e-4f55-b5c6-2fb85c5eb8f1 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] No waiting events found dispatching network-vif-unplugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:53 user nova-compute[75113]: WARNING nova.compute.manager [req-4220eeb1-7bef-4fef-948c-94147ca042af req-872e5e72-155e-4f55-b5c6-2fb85c5eb8f1 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received unexpected event network-vif-unplugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:05:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:53 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Instance destroyed successfully.
Oct 26 17:05:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-70ea9527-9f62-40f4-8cf2-0354750bc26a req-d655335b-66e8-40de-b65f-e4660c1674d1 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-70ea9527-9f62-40f4-8cf2-0354750bc26a req-d655335b-66e8-40de-b65f-e4660c1674d1 service nova] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-70ea9527-9f62-40f4-8cf2-0354750bc26a req-d655335b-66e8-40de-b65f-e4660c1674d1 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-70ea9527-9f62-40f4-8cf2-0354750bc26a req-d655335b-66e8-40de-b65f-e4660c1674d1 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-70ea9527-9f62-40f4-8cf2-0354750bc26a req-d655335b-66e8-40de-b65f-e4660c1674d1 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] No waiting events found dispatching network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:55 user nova-compute[75113]: WARNING nova.compute.manager [req-70ea9527-9f62-40f4-8cf2-0354750bc26a req-d655335b-66e8-40de-b65f-e4660c1674d1 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received unexpected event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:05:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:05:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:56 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:05:57 user nova-compute[75113]: INFO nova.compute.claims [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Claim successful on node user
Oct 26 17:05:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-7476553e-c2a1-4245-8341-221bccfcd297 req-b8223f48-2b47-471a-a31e-2afa217a12d0 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7476553e-c2a1-4245-8341-221bccfcd297 req-b8223f48-2b47-471a-a31e-2afa217a12d0 service nova] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7476553e-c2a1-4245-8341-221bccfcd297 req-b8223f48-2b47-471a-a31e-2afa217a12d0 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7476553e-c2a1-4245-8341-221bccfcd297 req-b8223f48-2b47-471a-a31e-2afa217a12d0 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-7476553e-c2a1-4245-8341-221bccfcd297 req-b8223f48-2b47-471a-a31e-2afa217a12d0 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] No waiting events found dispatching network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:57 user nova-compute[75113]: WARNING nova.compute.manager [req-7476553e-c2a1-4245-8341-221bccfcd297 req-b8223f48-2b47-471a-a31e-2afa217a12d0 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received unexpected event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:05:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-7476553e-c2a1-4245-8341-221bccfcd297 req-b8223f48-2b47-471a-a31e-2afa217a12d0 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7476553e-c2a1-4245-8341-221bccfcd297 req-b8223f48-2b47-471a-a31e-2afa217a12d0 service nova] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7476553e-c2a1-4245-8341-221bccfcd297 req-b8223f48-2b47-471a-a31e-2afa217a12d0 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7476553e-c2a1-4245-8341-221bccfcd297 req-b8223f48-2b47-471a-a31e-2afa217a12d0 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-7476553e-c2a1-4245-8341-221bccfcd297 req-b8223f48-2b47-471a-a31e-2afa217a12d0 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] No waiting events found dispatching network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:05:57 user nova-compute[75113]: WARNING nova.compute.manager [req-7476553e-c2a1-4245-8341-221bccfcd297 req-b8223f48-2b47-471a-a31e-2afa217a12d0 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received unexpected event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:05:57 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:05:57 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:05:57 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:05:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG nova.policy [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25d708e692104c63ac2e25531e82d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0d356ed9284735abb524c73c143e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:05:58 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Creating image(s)
Oct 26 17:05:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "/opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "/opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "63ea650eb6ba60c8bbc5758b3c0ce68dccec9835" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "63ea650eb6ba60c8bbc5758b3c0ce68dccec9835" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5bcdfbd2-2b1a-4a46-bddf-68f218e6ad1c tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835.part --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Successfully created port: 95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835.part --force-share --output=json" returned: 0 in 0.205s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG nova.virt.images [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] 98ae3601-3e3c-41b2-8eae-e15758611bbc was qcow2, converting to raw {{(pid=75113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 17:05:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835.part /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835.converted {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835.part /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835.converted" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835.converted --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835.converted --force-share --output=json" returned: 0 in 0.234s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "63ea650eb6ba60c8bbc5758b3c0ce68dccec9835" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.202s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835 --force-share --output=json" returned: 0 in 0.198s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "63ea650eb6ba60c8bbc5758b3c0ce68dccec9835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "63ea650eb6ba60c8bbc5758b3c0ce68dccec9835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Successfully updated port: 95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquired lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-b212cd5b-5d3e-46e1-8e93-ef0fe2ebbe00 req-e3b15604-9a49-42de-9be9-45c1c810327c service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-changed-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-b212cd5b-5d3e-46e1-8e93-ef0fe2ebbe00 req-e3b15604-9a49-42de-9be9-45c1c810327c service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Refreshing instance network info cache due to event network-changed-95e2347e-eaa3-4136-a60c-c31645b50944. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b212cd5b-5d3e-46e1-8e93-ef0fe2ebbe00 req-e3b15604-9a49-42de-9be9-45c1c810327c service nova] Acquiring lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835 --force-share --output=json" returned: 0 in 0.219s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835,backing_fmt=raw /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835,backing_fmt=raw /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk 1073741824" returned: 0 in 0.063s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "63ea650eb6ba60c8bbc5758b3c0ce68dccec9835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:05:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-a45384ae-b943-4bda-9a4a-074f35b47235 req-7afc32b5-d4b1-401d-802a-ab34a7764042 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received event volume-reimaged-c2de619a-4ee3-47dd-8780-dd158767fe24 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a45384ae-b943-4bda-9a4a-074f35b47235 req-7afc32b5-d4b1-401d-802a-ab34a7764042 service nova] Acquiring lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a45384ae-b943-4bda-9a4a-074f35b47235 req-7afc32b5-d4b1-401d-802a-ab34a7764042 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a45384ae-b943-4bda-9a4a-074f35b47235 req-7afc32b5-d4b1-401d-802a-ab34a7764042 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-a45384ae-b943-4bda-9a4a-074f35b47235 req-7afc32b5-d4b1-401d-802a-ab34a7764042 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Processing event volume-reimaged-c2de619a-4ee3-47dd-8780-dd158767fe24 {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63ea650eb6ba60c8bbc5758b3c0ce68dccec9835 --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Instance event wait completed in 32 seconds for volume-reimaged {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:00 user nova-compute[75113]: INFO nova.virt.block_device [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Booting with volume c2de619a-4ee3-47dd-8780-dd158767fe24 at /dev/vda
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updating instance_info_cache with network_info: [{"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Releasing lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Instance network_info: |[{"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b212cd5b-5d3e-46e1-8e93-ef0fe2ebbe00 req-e3b15604-9a49-42de-9be9-45c1c810327c service nova] Acquired lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.network.neutron [req-b212cd5b-5d3e-46e1-8e93-ef0fe2ebbe00 req-e3b15604-9a49-42de-9be9-45c1c810327c service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Refreshing network info cache for port 95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG os_brick.utils [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[920f9041-9f51-4b73-90cf-2a606ab6a7a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e272a40-774f-467a-bea0-d52a8be6bed6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Cannot resize image /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Ensure instance console log exists: /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Start _get_guest_xml network_info=[{"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T17:05:53Z,direct_url=<?>,disk_format='qcow2',id=98ae3601-3e3c-41b2-8eae-e15758611bbc,min_disk=0,min_ram=0,name='tempest-scenario-img--1521803014',owner='dd0d356ed9284735abb524c73c143e3b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T17:05:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '98ae3601-3e3c-41b2-8eae-e15758611bbc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af37797-3783-4268-8b74-b9117deecc48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86d8305-4222-4d7c-a518-b6d74f0dea21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:00 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:06:00 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:06:00 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4587d803-3c22-4a8c-90a2-2a0e58d1dd7e]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG os_brick.utils [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Updating existing volume attachment record: b18753c6-e498-4669-8a1d-28473d6b0d50 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T17:05:53Z,direct_url=<?>,disk_format='qcow2',id=98ae3601-3e3c-41b2-8eae-e15758611bbc,min_disk=0,min_ram=0,name='tempest-scenario-img--1521803014',owner='dd0d356ed9284735abb524c73c143e3b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T17:05:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-940404062',display_name='tempest-TestMinimumBasicScenario-server-940404062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-940404062',id=27,image_ref='98ae3601-3e3c-41b2-8eae-e15758611bbc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs1uR/3mKK4kARjORzAU06qrPd5MWUuYXlnKeBYlOM72uDOOq+2m2u6XN051ku1d07tujNMi5RcoO9SSyPmXeXcPN/yr14TE+1CgGiHQc9orBXrG38V9jd5fmCVOHzUGg==',key_name='tempest-TestMinimumBasicScenario-1008493048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd0d356ed9284735abb524c73c143e3b',ramdisk_id='',reservation_id='r-m9b890eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='98ae3601-3e3c-41b2-8eae-e15758611bbc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1757884343',owner_user_name='tempest-TestMinimumBasicScenario-1757884343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:05:58Z,user_data=None,user_id='25d708e692104c63ac2e25531e82d734',uuid=b5a937c5-26b1-42a2-ad61-660e66688cf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converting VIF {"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:94:9a,bridge_name='br-int',has_traffic_filtering=True,id=95e2347e-eaa3-4136-a60c-c31645b50944,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e2347e-ea') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.objects.instance [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'pci_devices' on Instance uuid b5a937c5-26b1-42a2-ad61-660e66688cf8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:06:00 user nova-compute[75113]:   <uuid>b5a937c5-26b1-42a2-ad61-660e66688cf8</uuid>
Oct 26 17:06:00 user nova-compute[75113]:   <name>instance-0000001b</name>
Oct 26 17:06:00 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:06:00 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:06:00 user nova-compute[75113]:   <metadata>
Oct 26 17:06:00 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:06:00 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:06:00 user nova-compute[75113]:       <nova:name>tempest-TestMinimumBasicScenario-server-940404062</nova:name>
Oct 26 17:06:00 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:06:00</nova:creationTime>
Oct 26 17:06:00 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:06:00 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:06:00 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:06:00 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:06:00 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:06:00 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:06:00 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:06:00 user nova-compute[75113]:       <nova:owner>
Oct 26 17:06:00 user nova-compute[75113]:         <nova:user uuid="25d708e692104c63ac2e25531e82d734">tempest-TestMinimumBasicScenario-1757884343-project-member</nova:user>
Oct 26 17:06:00 user nova-compute[75113]:         <nova:project uuid="dd0d356ed9284735abb524c73c143e3b">tempest-TestMinimumBasicScenario-1757884343</nova:project>
Oct 26 17:06:00 user nova-compute[75113]:       </nova:owner>
Oct 26 17:06:00 user nova-compute[75113]:       <nova:root type="image" uuid="98ae3601-3e3c-41b2-8eae-e15758611bbc"/>
Oct 26 17:06:00 user nova-compute[75113]:       <nova:ports>
Oct 26 17:06:00 user nova-compute[75113]:         <nova:port uuid="95e2347e-eaa3-4136-a60c-c31645b50944">
Oct 26 17:06:00 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 17:06:00 user nova-compute[75113]:         </nova:port>
Oct 26 17:06:00 user nova-compute[75113]:       </nova:ports>
Oct 26 17:06:00 user nova-compute[75113]:     </nova:instance>
Oct 26 17:06:00 user nova-compute[75113]:   </metadata>
Oct 26 17:06:00 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:06:00 user nova-compute[75113]:     <system>
Oct 26 17:06:00 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:06:00 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:06:00 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:06:00 user nova-compute[75113]:       <entry name="serial">b5a937c5-26b1-42a2-ad61-660e66688cf8</entry>
Oct 26 17:06:00 user nova-compute[75113]:       <entry name="uuid">b5a937c5-26b1-42a2-ad61-660e66688cf8</entry>
Oct 26 17:06:00 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:06:00 user nova-compute[75113]:     </system>
Oct 26 17:06:00 user nova-compute[75113]:   </sysinfo>
Oct 26 17:06:00 user nova-compute[75113]:   <os>
Oct 26 17:06:00 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:06:00 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:06:00 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:06:00 user nova-compute[75113]:   </os>
Oct 26 17:06:00 user nova-compute[75113]:   <features>
Oct 26 17:06:00 user nova-compute[75113]:     <acpi/>
Oct 26 17:06:00 user nova-compute[75113]:     <apic/>
Oct 26 17:06:00 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:06:00 user nova-compute[75113]:   </features>
Oct 26 17:06:00 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:06:00 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:06:00 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:06:00 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:06:00 user nova-compute[75113]:   </clock>
Oct 26 17:06:00 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:06:00 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:06:00 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:06:00 user nova-compute[75113]:   </cpu>
Oct 26 17:06:00 user nova-compute[75113]:   <devices>
Oct 26 17:06:00 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:06:00 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:06:00 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk"/>
Oct 26 17:06:00 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:06:00 user nova-compute[75113]:     </disk>
Oct 26 17:06:00 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:06:00 user nova-compute[75113]:       <mac address="fa:16:3e:68:94:9a"/>
Oct 26 17:06:00 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:06:00 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:06:00 user nova-compute[75113]:       <target dev="tap95e2347e-ea"/>
Oct 26 17:06:00 user nova-compute[75113]:     </interface>
Oct 26 17:06:00 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:06:00 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/console.log" append="off"/>
Oct 26 17:06:00 user nova-compute[75113]:     </serial>
Oct 26 17:06:00 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:06:00 user nova-compute[75113]:     <video>
Oct 26 17:06:00 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:06:00 user nova-compute[75113]:     </video>
Oct 26 17:06:00 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:06:00 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:06:00 user nova-compute[75113]:     </rng>
Oct 26 17:06:00 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:06:00 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:06:00 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:06:00 user nova-compute[75113]:     </memballoon>
Oct 26 17:06:00 user nova-compute[75113]:   </devices>
Oct 26 17:06:00 user nova-compute[75113]: </domain>
Oct 26 17:06:00 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-940404062',display_name='tempest-TestMinimumBasicScenario-server-940404062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-940404062',id=27,image_ref='98ae3601-3e3c-41b2-8eae-e15758611bbc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs1uR/3mKK4kARjORzAU06qrPd5MWUuYXlnKeBYlOM72uDOOq+2m2u6XN051ku1d07tujNMi5RcoO9SSyPmXeXcPN/yr14TE+1CgGiHQc9orBXrG38V9jd5fmCVOHzUGg==',key_name='tempest-TestMinimumBasicScenario-1008493048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd0d356ed9284735abb524c73c143e3b',ramdisk_id='',reservation_id='r-m9b890eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='98ae3601-3e3c-41b2-8eae-e15758611bbc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1757884343',owner_user_name='tempest-TestMinimumBasicScenario-1757884343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:05:58Z,user_data=None,user_id='25d708e692104c63ac2e25531e82d734',uuid=b5a937c5-26b1-42a2-ad61-660e66688cf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converting VIF {"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:94:9a,bridge_name='br-int',has_traffic_filtering=True,id=95e2347e-eaa3-4136-a60c-c31645b50944,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e2347e-ea') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG os_vif [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:94:9a,bridge_name='br-int',has_traffic_filtering=True,id=95e2347e-eaa3-4136-a60c-c31645b50944,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e2347e-ea') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '741864e3-200b-50e2-a934-c3bded988106', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95e2347e-ea, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95e2347e-ea, col_values=(('qos', UUID('ec576df3-32e2-4b49-b93f-60225cd4da66')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95e2347e-ea, col_values=(('external_ids', {'iface-id': '95e2347e-eaa3-4136-a60c-c31645b50944', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:94:9a', 'vm-uuid': 'b5a937c5-26b1-42a2-ad61-660e66688cf8'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:00 user nova-compute[75113]: INFO os_vif [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:94:9a,bridge_name='br-int',has_traffic_filtering=True,id=95e2347e-eaa3-4136-a60c-c31645b50944,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e2347e-ea')
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] No VIF found with MAC fa:16:3e:68:94:9a, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.network.neutron [req-b212cd5b-5d3e-46e1-8e93-ef0fe2ebbe00 req-e3b15604-9a49-42de-9be9-45c1c810327c service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updated VIF entry in instance network info cache for port 95e2347e-eaa3-4136-a60c-c31645b50944. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG nova.network.neutron [req-b212cd5b-5d3e-46e1-8e93-ef0fe2ebbe00 req-e3b15604-9a49-42de-9be9-45c1c810327c service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updating instance_info_cache with network_info: [{"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:06:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b212cd5b-5d3e-46e1-8e93-ef0fe2ebbe00 req-e3b15604-9a49-42de-9be9-45c1c810327c service nova] Releasing lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:06:01 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:06:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:02 user nova-compute[75113]: DEBUG nova.compute.manager [req-bb9e6cf6-1f13-4043-9a9d-25c8e35b7044 req-082a2407-1c74-4cff-a13e-0a25deac86b9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:06:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-bb9e6cf6-1f13-4043-9a9d-25c8e35b7044 req-082a2407-1c74-4cff-a13e-0a25deac86b9 service nova] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-bb9e6cf6-1f13-4043-9a9d-25c8e35b7044 req-082a2407-1c74-4cff-a13e-0a25deac86b9 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-bb9e6cf6-1f13-4043-9a9d-25c8e35b7044 req-082a2407-1c74-4cff-a13e-0a25deac86b9 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:02 user nova-compute[75113]: DEBUG nova.compute.manager [req-bb9e6cf6-1f13-4043-9a9d-25c8e35b7044 req-082a2407-1c74-4cff-a13e-0a25deac86b9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] No waiting events found dispatching network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:06:02 user nova-compute[75113]: WARNING nova.compute.manager [req-bb9e6cf6-1f13-4043-9a9d-25c8e35b7044 req-082a2407-1c74-4cff-a13e-0a25deac86b9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received unexpected event network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 for instance with vm_state building and task_state spawning.
Oct 26 17:06:02 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:06:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:06:03 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:06:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:06:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:06:03 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:06:03 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updating instance_info_cache with network_info: [{"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:06:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:06:03 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:06:04 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:06:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-60218d51-c285-4231-b719-3a4b0b0cda75 req-85d5c890-1e1b-452e-bce7-baff8ea91bc6 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:06:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-60218d51-c285-4231-b719-3a4b0b0cda75 req-85d5c890-1e1b-452e-bce7-baff8ea91bc6 service nova] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-60218d51-c285-4231-b719-3a4b0b0cda75 req-85d5c890-1e1b-452e-bce7-baff8ea91bc6 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-60218d51-c285-4231-b719-3a4b0b0cda75 req-85d5c890-1e1b-452e-bce7-baff8ea91bc6 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-60218d51-c285-4231-b719-3a4b0b0cda75 req-85d5c890-1e1b-452e-bce7-baff8ea91bc6 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] No waiting events found dispatching network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:06:04 user nova-compute[75113]: WARNING nova.compute.manager [req-60218d51-c285-4231-b719-3a4b0b0cda75 req-85d5c890-1e1b-452e-bce7-baff8ea91bc6 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received unexpected event network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 for instance with vm_state building and task_state spawning.
Oct 26 17:06:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:06:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:06:04 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Instance spawned successfully.
Oct 26 17:06:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:06:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:06:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:06:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:06:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:06:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:06:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:06:04 user nova-compute[75113]: INFO nova.compute.manager [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Took 6.61 seconds to spawn the instance on the hypervisor.
Oct 26 17:06:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:06:04 user nova-compute[75113]: INFO nova.compute.manager [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Took 7.77 seconds to build instance.
Oct 26 17:06:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ce6638e2-4480-4d31-8813-5e0aedaf6714 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.929s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:06:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:07 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:06:07 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:06:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:07 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:06:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:06:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:06:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:06:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:12 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:06:12 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7678MB free_disk=25.094348907470703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 37683519-d90a-4fa4-8e8f-cc883a2573ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 870b7db3-6425-4596-a942-736eccf07ebd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b5a937c5-26b1-42a2-ad61-660e66688cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:06:12 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:06:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:06:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:13 user nova-compute[75113]: INFO nova.compute.manager [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Detaching volume c25fb754-b910-43a7-aa08-368f0b708322
Oct 26 17:06:13 user nova-compute[75113]: INFO nova.virt.block_device [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Attempting to driver detach volume c25fb754-b910-43a7-aa08-368f0b708322 from mountpoint /dev/vdb
Oct 26 17:06:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Attempting to detach device vdb from instance 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:06:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:06:13 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:06:13 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:06:13 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:06:13 user nova-compute[75113]:   <serial>c25fb754-b910-43a7-aa08-368f0b708322</serial>
Oct 26 17:06:13 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:06:13 user nova-compute[75113]: </disk>
Oct 26 17:06:13 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:06:13 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Successfully detached device vdb from instance 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 from the persistent domain config.
Oct 26 17:06:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:06:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:06:13 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:06:13 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:06:13 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:06:13 user nova-compute[75113]:   <serial>c25fb754-b910-43a7-aa08-368f0b708322</serial>
Oct 26 17:06:13 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:06:13 user nova-compute[75113]: </disk>
Oct 26 17:06:13 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:06:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:06:15 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:06:15 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:06:15 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:06:15 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:06:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:06:22 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Creating image(s)
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Ensure instance console log exists: /opt/stack/data/nova/instances/37683519-d90a-4fa4-8e8f-cc883a2573ac/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Start _get_guest_xml network_info=[{"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b18753c6-e498-4669-8a1d-28473d6b0d50', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNKpJYag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '37683519-d90a-4fa4-8e8f-cc883a2573ac', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2de619a-4ee3-47dd-8780-dd158767fe24', 'serial': 'c2de619a-4ee3-47dd-8780-dd158767fe24'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:06:22 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 17:06:22 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lazy-loading 'vcpu_model' on Instance uuid 37683519-d90a-4fa4-8e8f-cc883a2573ac {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNKpJYag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:06:22 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:06:22 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:06:22 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3124c35b-07c8-4305-a123-59b31a3933f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:06:22 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b213176b-210f-4a04-a1a5-4f7a5c9173a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24] added
Oct 26 17:06:22 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20e9c4c-b996-49c7-9e6b-f508c67653fe]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f7f198-d58d-4569-ba9c-d2d586b7ce6d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNKpJYag {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNKpJYag" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[964f43ac-753d-4053-90fd-bda9ca9afa78]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BNKpJYag'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a771bde8-0583-4319-aab7-5dd69e5905b6]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9217a3-6302-499c-a9c4-4835503c5c2f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:06:22 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:06:22 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:06:22 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:06:22 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:06:22 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:06:22 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[258faac8-61f1-4ca9-a988-4dcc7d4d0072]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260]
Oct 26 17:06:22 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260] successful.
Oct 26 17:06:22 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[952aba75-0bab-4bea-b491-a263850352bd]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a2f7e4-0f81-47be-ae74-1f2cb1e66e76]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:06:22 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:06:22 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:06:22 user nova-compute[75113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:06:22 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:06:22 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:06:22 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:06:22 user nova-compute[75113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:06:22 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa351d-2340-40b8-8afe-047b181a99a5]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:22 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNKpJYag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23739353231663262', 'path': '/dev/sde'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739353231663262', 'path': '/dev/sde'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-208554010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1698414037',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdPVR8jrmmvs+FA1zsu8BhsOGQFKaF3g3dbAYbTOUQUphGdHDb5ZBl+LTAW9kwLngnlZjZt/Fup1ZMGDest0Syvi7iB20PUTksvIR3dTjbbM0POZ2eFVo0aHjgMG+Kq4A==',key_name='tempest-keypair-352373129',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e3ef36922d4fb7902344a5e66d9941',ramdisk_id='',reservation_id='r-vdp0td0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1360395865',owner_user_name='tempest-ServerActionsV293TestJSON-1360395865-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9de31526e7d049c0933bd981347ad67b',uuid=37683519-d90a-4fa4-8e8f-cc883a2573ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Converting VIF {"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:06:23 user nova-compute[75113]:   <uuid>37683519-d90a-4fa4-8e8f-cc883a2573ac</uuid>
Oct 26 17:06:23 user nova-compute[75113]:   <name>instance-00000019</name>
Oct 26 17:06:23 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:06:23 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:06:23 user nova-compute[75113]:   <metadata>
Oct 26 17:06:23 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:06:23 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:06:23 user nova-compute[75113]:       <nova:name>tempest-ServerActionsV293TestJSON-server-208554010</nova:name>
Oct 26 17:06:23 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:06:22</nova:creationTime>
Oct 26 17:06:23 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:06:23 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:06:23 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:06:23 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:06:23 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:06:23 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:06:23 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:06:23 user nova-compute[75113]:       <nova:owner>
Oct 26 17:06:23 user nova-compute[75113]:         <nova:user uuid="9de31526e7d049c0933bd981347ad67b">tempest-ServerActionsV293TestJSON-1360395865-project-member</nova:user>
Oct 26 17:06:23 user nova-compute[75113]:         <nova:project uuid="71e3ef36922d4fb7902344a5e66d9941">tempest-ServerActionsV293TestJSON-1360395865</nova:project>
Oct 26 17:06:23 user nova-compute[75113]:       </nova:owner>
Oct 26 17:06:23 user nova-compute[75113]:       <nova:ports>
Oct 26 17:06:23 user nova-compute[75113]:         <nova:port uuid="d7e20a2e-c0b5-4551-bc13-e3ef233eae81">
Oct 26 17:06:23 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 17:06:23 user nova-compute[75113]:         </nova:port>
Oct 26 17:06:23 user nova-compute[75113]:       </nova:ports>
Oct 26 17:06:23 user nova-compute[75113]:     </nova:instance>
Oct 26 17:06:23 user nova-compute[75113]:   </metadata>
Oct 26 17:06:23 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:06:23 user nova-compute[75113]:     <system>
Oct 26 17:06:23 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:06:23 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:06:23 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:06:23 user nova-compute[75113]:       <entry name="serial">37683519-d90a-4fa4-8e8f-cc883a2573ac</entry>
Oct 26 17:06:23 user nova-compute[75113]:       <entry name="uuid">37683519-d90a-4fa4-8e8f-cc883a2573ac</entry>
Oct 26 17:06:23 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:06:23 user nova-compute[75113]:     </system>
Oct 26 17:06:23 user nova-compute[75113]:   </sysinfo>
Oct 26 17:06:23 user nova-compute[75113]:   <os>
Oct 26 17:06:23 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:06:23 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:06:23 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:06:23 user nova-compute[75113]:   </os>
Oct 26 17:06:23 user nova-compute[75113]:   <features>
Oct 26 17:06:23 user nova-compute[75113]:     <acpi/>
Oct 26 17:06:23 user nova-compute[75113]:     <apic/>
Oct 26 17:06:23 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:06:23 user nova-compute[75113]:   </features>
Oct 26 17:06:23 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:06:23 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:06:23 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:06:23 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:06:23 user nova-compute[75113]:   </clock>
Oct 26 17:06:23 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:06:23 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:06:23 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:06:23 user nova-compute[75113]:   </cpu>
Oct 26 17:06:23 user nova-compute[75113]:   <devices>
Oct 26 17:06:23 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:06:23 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:06:23 user nova-compute[75113]:       <source dev="/dev/sde"/>
Oct 26 17:06:23 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:06:23 user nova-compute[75113]:       <serial>c2de619a-4ee3-47dd-8780-dd158767fe24</serial>
Oct 26 17:06:23 user nova-compute[75113]:     </disk>
Oct 26 17:06:23 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:06:23 user nova-compute[75113]:       <mac address="fa:16:3e:a2:c2:3a"/>
Oct 26 17:06:23 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:06:23 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:06:23 user nova-compute[75113]:       <target dev="tapd7e20a2e-c0"/>
Oct 26 17:06:23 user nova-compute[75113]:     </interface>
Oct 26 17:06:23 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:06:23 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/37683519-d90a-4fa4-8e8f-cc883a2573ac/console.log" append="off"/>
Oct 26 17:06:23 user nova-compute[75113]:     </serial>
Oct 26 17:06:23 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:06:23 user nova-compute[75113]:     <video>
Oct 26 17:06:23 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:06:23 user nova-compute[75113]:     </video>
Oct 26 17:06:23 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:06:23 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:06:23 user nova-compute[75113]:     </rng>
Oct 26 17:06:23 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:06:23 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:06:23 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:06:23 user nova-compute[75113]:     </memballoon>
Oct 26 17:06:23 user nova-compute[75113]:   </devices>
Oct 26 17:06:23 user nova-compute[75113]: </domain>
Oct 26 17:06:23 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-208554010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1698414037',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdPVR8jrmmvs+FA1zsu8BhsOGQFKaF3g3dbAYbTOUQUphGdHDb5ZBl+LTAW9kwLngnlZjZt/Fup1ZMGDest0Syvi7iB20PUTksvIR3dTjbbM0POZ2eFVo0aHjgMG+Kq4A==',key_name='tempest-keypair-352373129',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e3ef36922d4fb7902344a5e66d9941',ramdisk_id='',reservation_id='r-vdp0td0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1360395865',owner_user_name='tempest-ServerActionsV293TestJSON-1360395865-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9de31526e7d049c0933bd981347ad67b',uuid=37683519-d90a-4fa4-8e8f-cc883a2573ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Converting VIF {"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG os_vif [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1931371-6aff-53e9-8da4-a1672e50d866', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7e20a2e-c0, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7e20a2e-c0, col_values=(('qos', UUID('eb2d29f3-7ae0-42b6-958c-802dc06f85f3')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7e20a2e-c0, col_values=(('external_ids', {'iface-id': 'd7e20a2e-c0b5-4551-bc13-e3ef233eae81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:c2:3a', 'vm-uuid': '37683519-d90a-4fa4-8e8f-cc883a2573ac'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:06:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:23 user nova-compute[75113]: INFO os_vif [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0')
Oct 26 17:06:24 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:06:24 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] No VIF found with MAC fa:16:3e:a2:c2:3a, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:06:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-b16ff58f-5a27-4420-8a33-ce9992afcb02 req-c97e42fe-a996-4327-a129-2a00b7ed8914 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received event network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:06:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b16ff58f-5a27-4420-8a33-ce9992afcb02 req-c97e42fe-a996-4327-a129-2a00b7ed8914 service nova] Acquiring lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b16ff58f-5a27-4420-8a33-ce9992afcb02 req-c97e42fe-a996-4327-a129-2a00b7ed8914 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b16ff58f-5a27-4420-8a33-ce9992afcb02 req-c97e42fe-a996-4327-a129-2a00b7ed8914 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-b16ff58f-5a27-4420-8a33-ce9992afcb02 req-c97e42fe-a996-4327-a129-2a00b7ed8914 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] No waiting events found dispatching network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:06:25 user nova-compute[75113]: WARNING nova.compute.manager [req-b16ff58f-5a27-4420-8a33-ce9992afcb02 req-c97e42fe-a996-4327-a129-2a00b7ed8914 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received unexpected event network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 for instance with vm_state active and task_state rebuild_spawning.
Oct 26 17:06:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-3d246ddc-9419-4b5c-82f4-f96fd2e08a9a req-a08e2120-9dbd-4944-ac21-2241c7436ae0 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received event network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3d246ddc-9419-4b5c-82f4-f96fd2e08a9a req-a08e2120-9dbd-4944-ac21-2241c7436ae0 service nova] Acquiring lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3d246ddc-9419-4b5c-82f4-f96fd2e08a9a req-a08e2120-9dbd-4944-ac21-2241c7436ae0 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3d246ddc-9419-4b5c-82f4-f96fd2e08a9a req-a08e2120-9dbd-4944-ac21-2241c7436ae0 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-3d246ddc-9419-4b5c-82f4-f96fd2e08a9a req-a08e2120-9dbd-4944-ac21-2241c7436ae0 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] No waiting events found dispatching network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:06:27 user nova-compute[75113]: WARNING nova.compute.manager [req-3d246ddc-9419-4b5c-82f4-f96fd2e08a9a req-a08e2120-9dbd-4944-ac21-2241c7436ae0 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received unexpected event network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 for instance with vm_state active and task_state rebuild_spawning.
Oct 26 17:06:27 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Instance spawned successfully.
Oct 26 17:06:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75113) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 26 17:06:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a45384ae-b943-4bda-9a4a-074f35b47235 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.087s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:34 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 is timed out.
Oct 26 17:06:34 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Successfully detached device vdb from instance 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 from the live domain config.
Oct 26 17:06:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbFkRial', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:06:34 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf24749-09f4-41e3-8139-3c50a189afcb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:06:34 user nova-compute[75113]: No targets found.
Oct 26 17:06:34 user nova-compute[75113]: iSNS:
Oct 26 17:06:34 user nova-compute[75113]: No targets found.
Oct 26 17:06:34 user nova-compute[75113]: STATIC:
Oct 26 17:06:34 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804
Oct 26 17:06:34 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:06:34 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:06:34 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:06:34 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:06:34 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:06:34 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322
Oct 26 17:06:34 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:06:34 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:06:34 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24
Oct 26 17:06:34 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:06:34 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:06:34 user nova-compute[75113]: FIRMWARE:
Oct 26 17:06:34 user nova-compute[75113]: No targets found.
Oct 26 17:06:34 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:06:34 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:06:34 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[974b2d36-283b-4100-ad83-71b8b87dd885]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[86300b6b-9e67-40d4-aec6-ff59a8c37bbb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:06:34 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:06:34 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:06:34 user nova-compute[75113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:06:34 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:06:34 user nova-compute[75113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 (non-flash)
Oct 26 17:06:34 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:06:34 user nova-compute[75113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:06:34 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914355bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322'): ({'sdc'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Removing single pathed devices sdc {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[241aaf7e-b246-470a-9dbe-12f1483e5d5a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[38be05cb-4df5-4ecf-bc4b-eb7cd5d54e19]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Flushing IO for device /dev/sdc {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[83397e73-19d9-4966-99d5-37f348ab6c05]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aa3de2-fbdf-418b-8f83-4308559f9c9a]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87df371-f37b-4e1a-aca6-b4b00f6e8652]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f343a7-2f0d-4e7b-ba89-7b6ede307e7d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322, portal: 172.16.0.220,3260]
Oct 26 17:06:34 user nova-compute[75113]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322, portal: 172.16.0.220,3260] successful.
Oct 26 17:06:34 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d0be5f-584d-44c5-9549-9e0a36f99c53]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] <== disconnect_volume: return (347ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:06:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:06:35 user nova-compute[75113]: DEBUG nova.objects.instance [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lazy-loading 'flavor' on Instance uuid 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:06:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5321366b-dd76-4fff-9722-79fadc06a853 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.979s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.815s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:35 user nova-compute[75113]: INFO nova.compute.manager [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Terminating instance
Oct 26 17:06:35 user nova-compute[75113]: DEBUG nova.compute.manager [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:06:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-34ccce5d-802a-49c4-ac77-49a765b0f8f0 req-03cd42aa-32fe-438d-b3a5-4fb0f64cdb7c service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Received event network-vif-unplugged-24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-34ccce5d-802a-49c4-ac77-49a765b0f8f0 req-03cd42aa-32fe-438d-b3a5-4fb0f64cdb7c service nova] Acquiring lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-34ccce5d-802a-49c4-ac77-49a765b0f8f0 req-03cd42aa-32fe-438d-b3a5-4fb0f64cdb7c service nova] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-34ccce5d-802a-49c4-ac77-49a765b0f8f0 req-03cd42aa-32fe-438d-b3a5-4fb0f64cdb7c service nova] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-34ccce5d-802a-49c4-ac77-49a765b0f8f0 req-03cd42aa-32fe-438d-b3a5-4fb0f64cdb7c service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] No waiting events found dispatching network-vif-unplugged-24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-34ccce5d-802a-49c4-ac77-49a765b0f8f0 req-03cd42aa-32fe-438d-b3a5-4fb0f64cdb7c service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Received event network-vif-unplugged-24851c98-7984-473a-9920-289d918c2949 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:36 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Instance destroyed successfully.
Oct 26 17:06:36 user nova-compute[75113]: DEBUG nova.objects.instance [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lazy-loading 'resources' on Instance uuid 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-901967333',display_name='tempest-VolumesSnapshotTestJSON-instance-901967333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-901967333',id=20,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDg2MJdHPrUCv6JsHJXkZ5NVLkm16m5HhEMsmjKeWBTQ23UoBKHNGP/wzzaIm0GgujmwcXo7NjIs0Xran/jF6aAK3bXnpZ7O4zzhEEm/VkqhSCDC+qmDTdJ+/6uqu6ISg==',key_name='tempest-keypair-1089554665',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:02:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49e6333344bf4cc6904e13f9fbe6005f',ramdisk_id='',reservation_id='r-ci4i1t45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1537589693',owner_user_name='tempest-VolumesSnapshotTestJSON-1537589693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22531c3975dc4e29ab0e7be404592d01',uuid=6ebdd6f0-640e-4c02-ac96-2d78fafb96e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24851c98-7984-473a-9920-289d918c2949", "address": "fa:16:3e:44:26:8c", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24851c98-79", "ovs_interfaceid": "24851c98-7984-473a-9920-289d918c2949", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Converting VIF {"id": "24851c98-7984-473a-9920-289d918c2949", "address": "fa:16:3e:44:26:8c", "network": {"id": "99af90d2-64e0-4412-932f-9ff00f113913", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2002050635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e6333344bf4cc6904e13f9fbe6005f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24851c98-79", "ovs_interfaceid": "24851c98-7984-473a-9920-289d918c2949", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:26:8c,bridge_name='br-int',has_traffic_filtering=True,id=24851c98-7984-473a-9920-289d918c2949,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24851c98-79') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG os_vif [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:26:8c,bridge_name='br-int',has_traffic_filtering=True,id=24851c98-7984-473a-9920-289d918c2949,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24851c98-79') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24851c98-79, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4042f2b-fca3-4c53-b4ab-69f6bc815e64) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:06:36 user nova-compute[75113]: INFO os_vif [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:26:8c,bridge_name='br-int',has_traffic_filtering=True,id=24851c98-7984-473a-9920-289d918c2949,network=Network(99af90d2-64e0-4412-932f-9ff00f113913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24851c98-79')
Oct 26 17:06:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbFkRial', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:06:36 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:06:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc277eb1-0a7c-43ce-9a15-9c4299c67733]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:06:36 user nova-compute[75113]: No targets found.
Oct 26 17:06:36 user nova-compute[75113]: iSNS:
Oct 26 17:06:36 user nova-compute[75113]: No targets found.
Oct 26 17:06:36 user nova-compute[75113]: STATIC:
Oct 26 17:06:36 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804
Oct 26 17:06:36 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:06:36 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:06:36 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:06:36 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:06:36 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:06:36 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24
Oct 26 17:06:36 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:06:36 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:06:36 user nova-compute[75113]: FIRMWARE:
Oct 26 17:06:36 user nova-compute[75113]: No targets found.
Oct 26 17:06:36 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:06:36 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:06:36 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c25fb754-b910-43a7-aa08-368f0b708322', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[027dc4d3-feb6-4587-a8bb-5fc8f6ad9222]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e40fa7-1e21-4bf9-be5e-5fc35deefc26]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:06:36 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:06:36 user nova-compute[75113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:06:36 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:06:36 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:06:36 user nova-compute[75113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:06:36 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49142137f0>, {}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Disconnecting from: [] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] <== disconnect_volume: return (79ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:06:36 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Deleting instance files /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1_del
Oct 26 17:06:36 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Deletion of /opt/stack/data/nova/instances/6ebdd6f0-640e-4c02-ac96-2d78fafb96e1_del complete
Oct 26 17:06:36 user nova-compute[75113]: INFO nova.compute.manager [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 26 17:06:36 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:06:36 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:06:37 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:06:37 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Took 1.04 seconds to deallocate network for instance.
Oct 26 17:06:38 user nova-compute[75113]: WARNING nova.volume.cinder [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Attachment 5e68cc4a-7576-4d5e-ba39-dc0b4d809b30 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5e68cc4a-7576-4d5e-ba39-dc0b4d809b30. (HTTP 404) (Request-ID: req-682283e6-8627-4eee-bd31-420f0e86f46d)
Oct 26 17:06:38 user nova-compute[75113]: INFO nova.compute.manager [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Took 0.03 seconds to detach 1 volumes for instance.
Oct 26 17:06:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-80c6de4f-9339-4fb0-9650-8e4e820191df req-3c2be8c6-c6ac-4150-b20e-b38d10bcc37d service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Received event network-vif-plugged-24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:06:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-80c6de4f-9339-4fb0-9650-8e4e820191df req-3c2be8c6-c6ac-4150-b20e-b38d10bcc37d service nova] Acquiring lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-80c6de4f-9339-4fb0-9650-8e4e820191df req-3c2be8c6-c6ac-4150-b20e-b38d10bcc37d service nova] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-80c6de4f-9339-4fb0-9650-8e4e820191df req-3c2be8c6-c6ac-4150-b20e-b38d10bcc37d service nova] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-80c6de4f-9339-4fb0-9650-8e4e820191df req-3c2be8c6-c6ac-4150-b20e-b38d10bcc37d service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] No waiting events found dispatching network-vif-plugged-24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:06:38 user nova-compute[75113]: WARNING nova.compute.manager [req-80c6de4f-9339-4fb0-9650-8e4e820191df req-3c2be8c6-c6ac-4150-b20e-b38d10bcc37d service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Received unexpected event network-vif-plugged-24851c98-7984-473a-9920-289d918c2949 for instance with vm_state deleted and task_state None.
Oct 26 17:06:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-80c6de4f-9339-4fb0-9650-8e4e820191df req-3c2be8c6-c6ac-4150-b20e-b38d10bcc37d service nova] [instance: 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1] Received event network-vif-deleted-24851c98-7984-473a-9920-289d918c2949 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:06:38 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:06:38 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:06:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:38 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Deleted allocations for instance 6ebdd6f0-640e-4c02-ac96-2d78fafb96e1
Oct 26 17:06:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-900acf32-a27d-4eae-8597-95fa5cec42a1 tempest-VolumesSnapshotTestJSON-1537589693 tempest-VolumesSnapshotTestJSON-1537589693-project-member] Lock "6ebdd6f0-640e-4c02-ac96-2d78fafb96e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.850s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "870b7db3-6425-4596-a942-736eccf07ebd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "870b7db3-6425-4596-a942-736eccf07ebd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "870b7db3-6425-4596-a942-736eccf07ebd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "870b7db3-6425-4596-a942-736eccf07ebd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "870b7db3-6425-4596-a942-736eccf07ebd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:41 user nova-compute[75113]: INFO nova.compute.manager [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Terminating instance
Oct 26 17:06:41 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-9d35dd55-6b52-48b9-9409-48b7331079f6 req-0da40a10-7bec-4489-8709-09266e06a395 service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Received event network-vif-unplugged-83c94f7d-a672-493b-a62c-ea525c08dcd9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9d35dd55-6b52-48b9-9409-48b7331079f6 req-0da40a10-7bec-4489-8709-09266e06a395 service nova] Acquiring lock "870b7db3-6425-4596-a942-736eccf07ebd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9d35dd55-6b52-48b9-9409-48b7331079f6 req-0da40a10-7bec-4489-8709-09266e06a395 service nova] Lock "870b7db3-6425-4596-a942-736eccf07ebd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9d35dd55-6b52-48b9-9409-48b7331079f6 req-0da40a10-7bec-4489-8709-09266e06a395 service nova] Lock "870b7db3-6425-4596-a942-736eccf07ebd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-9d35dd55-6b52-48b9-9409-48b7331079f6 req-0da40a10-7bec-4489-8709-09266e06a395 service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] No waiting events found dispatching network-vif-unplugged-83c94f7d-a672-493b-a62c-ea525c08dcd9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-9d35dd55-6b52-48b9-9409-48b7331079f6 req-0da40a10-7bec-4489-8709-09266e06a395 service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Received event network-vif-unplugged-83c94f7d-a672-493b-a62c-ea525c08dcd9 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Instance destroyed successfully.
Oct 26 17:06:42 user nova-compute[75113]: DEBUG nova.objects.instance [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lazy-loading 'resources' on Instance uuid 870b7db3-6425-4596-a942-736eccf07ebd {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:04:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1203335813',display_name='tempest-ServersNegativeTestJSON-server-1203335813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1203335813',id=26,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:04:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='786feb5d295e40868b844a95c26cf661',ramdisk_id='',reservation_id='r-3u8oyt2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1640105602',owner_user_name='tempest-ServersNegativeTestJSON-1640105602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:04:59Z,user_data=None,user_id='0c81e83d3ea04b2a8dabe3ac53205391',uuid=870b7db3-6425-4596-a942-736eccf07ebd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "address": "fa:16:3e:aa:84:c8", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c94f7d-a6", "ovs_interfaceid": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Converting VIF {"id": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "address": "fa:16:3e:aa:84:c8", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c94f7d-a6", "ovs_interfaceid": "83c94f7d-a672-493b-a62c-ea525c08dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=83c94f7d-a672-493b-a62c-ea525c08dcd9,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c94f7d-a6') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG os_vif [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=83c94f7d-a672-493b-a62c-ea525c08dcd9,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c94f7d-a6') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83c94f7d-a6, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d849634-39a1-4c39-91a3-9d3c2c12d4fd) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:06:42 user nova-compute[75113]: INFO os_vif [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=83c94f7d-a672-493b-a62c-ea525c08dcd9,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c94f7d-a6')
Oct 26 17:06:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Deleting instance files /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd_del
Oct 26 17:06:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Deletion of /opt/stack/data/nova/instances/870b7db3-6425-4596-a942-736eccf07ebd_del complete
Oct 26 17:06:42 user nova-compute[75113]: INFO nova.compute.manager [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 26 17:06:42 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:06:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:43 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:06:43 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Took 0.57 seconds to deallocate network for instance.
Oct 26 17:06:43 user nova-compute[75113]: DEBUG nova.compute.manager [req-051619c3-dde6-4d0c-9ec6-3a9999848e54 req-601a7bd6-42e5-4a6f-8099-ca92a30ade30 service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Received event network-vif-deleted-83c94f7d-a672-493b-a62c-ea525c08dcd9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:06:43 user nova-compute[75113]: INFO nova.compute.manager [req-051619c3-dde6-4d0c-9ec6-3a9999848e54 req-601a7bd6-42e5-4a6f-8099-ca92a30ade30 service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Neutron deleted interface 83c94f7d-a672-493b-a62c-ea525c08dcd9; detaching it from the instance and deleting it from the info cache
Oct 26 17:06:43 user nova-compute[75113]: DEBUG nova.network.neutron [req-051619c3-dde6-4d0c-9ec6-3a9999848e54 req-601a7bd6-42e5-4a6f-8099-ca92a30ade30 service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:06:43 user nova-compute[75113]: DEBUG nova.compute.manager [req-051619c3-dde6-4d0c-9ec6-3a9999848e54 req-601a7bd6-42e5-4a6f-8099-ca92a30ade30 service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Detach interface failed, port_id=83c94f7d-a672-493b-a62c-ea525c08dcd9, reason: Instance 870b7db3-6425-4596-a942-736eccf07ebd could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:06:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:43 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:06:43 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:06:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:43 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Deleted allocations for instance 870b7db3-6425-4596-a942-736eccf07ebd
Oct 26 17:06:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b5e337a4-1ae2-4ee1-a267-91444e58b170 tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "870b7db3-6425-4596-a942-736eccf07ebd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.108s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-b6797906-b491-419c-a75c-6f8cce60423c req-1e42100c-1c30-45ea-8af5-30acf68473a3 service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Received event network-vif-plugged-83c94f7d-a672-493b-a62c-ea525c08dcd9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:06:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b6797906-b491-419c-a75c-6f8cce60423c req-1e42100c-1c30-45ea-8af5-30acf68473a3 service nova] Acquiring lock "870b7db3-6425-4596-a942-736eccf07ebd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:06:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b6797906-b491-419c-a75c-6f8cce60423c req-1e42100c-1c30-45ea-8af5-30acf68473a3 service nova] Lock "870b7db3-6425-4596-a942-736eccf07ebd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:06:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b6797906-b491-419c-a75c-6f8cce60423c req-1e42100c-1c30-45ea-8af5-30acf68473a3 service nova] Lock "870b7db3-6425-4596-a942-736eccf07ebd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:06:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-b6797906-b491-419c-a75c-6f8cce60423c req-1e42100c-1c30-45ea-8af5-30acf68473a3 service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] No waiting events found dispatching network-vif-plugged-83c94f7d-a672-493b-a62c-ea525c08dcd9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:06:44 user nova-compute[75113]: WARNING nova.compute.manager [req-b6797906-b491-419c-a75c-6f8cce60423c req-1e42100c-1c30-45ea-8af5-30acf68473a3 service nova] [instance: 870b7db3-6425-4596-a942-736eccf07ebd] Received unexpected event network-vif-plugged-83c94f7d-a672-493b-a62c-ea525c08dcd9 for instance with vm_state deleted and task_state None.
Oct 26 17:06:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:06:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:02 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:07:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:07:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:07:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:07:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:07:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:07:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:07:05 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:07:05 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Updating instance_info_cache with network_info: [{"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:07:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:07:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:07:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:07:06 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:07:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:07:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:12 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:07:12 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7567MB free_disk=25.115097045898438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 37683519-d90a-4fa4-8e8f-cc883a2573ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b5a937c5-26b1-42a2-ad61-660e66688cf8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:07:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:14 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:07:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:07:15 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:07:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:07:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:07:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "7cbb27a2-37c5-4045-a005-719f79f30714" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "7cbb27a2-37c5-4045-a005-719f79f30714" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:07:45 user nova-compute[75113]: INFO nova.compute.claims [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Claim successful on node user
Oct 26 17:07:45 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG nova.network.neutron [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:07:45 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:07:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG nova.policy [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c431350f06fd4dbf8d74835f34626ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae5d124cb054dfbbe04433a685903bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:07:45 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Creating image(s)
Oct 26 17:07:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "/opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "/opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.193s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk 1073741824" returned: 0 in 0.069s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Successfully created port: 9423387c-270f-462d-bae1-c28813953dc9 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.190s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Cannot resize image /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Ensure instance console log exists: /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.network.neutron [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Successfully updated port: 9423387c-270f-462d-bae1-c28813953dc9 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "refresh_cache-7cbb27a2-37c5-4045-a005-719f79f30714" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquired lock "refresh_cache-7cbb27a2-37c5-4045-a005-719f79f30714" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.network.neutron [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-55bb2e7a-5e47-40de-a561-e051caf63266 req-448c0876-cf3c-489c-8fd1-8da8b09774bd service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Received event network-changed-9423387c-270f-462d-bae1-c28813953dc9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-55bb2e7a-5e47-40de-a561-e051caf63266 req-448c0876-cf3c-489c-8fd1-8da8b09774bd service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Refreshing instance network info cache due to event network-changed-9423387c-270f-462d-bae1-c28813953dc9. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55bb2e7a-5e47-40de-a561-e051caf63266 req-448c0876-cf3c-489c-8fd1-8da8b09774bd service nova] Acquiring lock "refresh_cache-7cbb27a2-37c5-4045-a005-719f79f30714" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.network.neutron [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.network.neutron [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Updating instance_info_cache with network_info: [{"id": "9423387c-270f-462d-bae1-c28813953dc9", "address": "fa:16:3e:ab:e3:d2", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9423387c-27", "ovs_interfaceid": "9423387c-270f-462d-bae1-c28813953dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Releasing lock "refresh_cache-7cbb27a2-37c5-4045-a005-719f79f30714" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Instance network_info: |[{"id": "9423387c-270f-462d-bae1-c28813953dc9", "address": "fa:16:3e:ab:e3:d2", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9423387c-27", "ovs_interfaceid": "9423387c-270f-462d-bae1-c28813953dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55bb2e7a-5e47-40de-a561-e051caf63266 req-448c0876-cf3c-489c-8fd1-8da8b09774bd service nova] Acquired lock "refresh_cache-7cbb27a2-37c5-4045-a005-719f79f30714" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.network.neutron [req-55bb2e7a-5e47-40de-a561-e051caf63266 req-448c0876-cf3c-489c-8fd1-8da8b09774bd service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Refreshing network info cache for port 9423387c-270f-462d-bae1-c28813953dc9 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Start _get_guest_xml network_info=[{"id": "9423387c-270f-462d-bae1-c28813953dc9", "address": "fa:16:3e:ab:e3:d2", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9423387c-27", "ovs_interfaceid": "9423387c-270f-462d-bae1-c28813953dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:07:47 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:07:47 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-37723291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-37723291',id=28,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-b6ygjdbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:07:46Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=7cbb27a2-37c5-4045-a005-719f79f30714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9423387c-270f-462d-bae1-c28813953dc9", "address": "fa:16:3e:ab:e3:d2", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9423387c-27", "ovs_interfaceid": "9423387c-270f-462d-bae1-c28813953dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "9423387c-270f-462d-bae1-c28813953dc9", "address": "fa:16:3e:ab:e3:d2", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9423387c-27", "ovs_interfaceid": "9423387c-270f-462d-bae1-c28813953dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:e3:d2,bridge_name='br-int',has_traffic_filtering=True,id=9423387c-270f-462d-bae1-c28813953dc9,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9423387c-27') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.objects.instance [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cbb27a2-37c5-4045-a005-719f79f30714 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:07:47 user nova-compute[75113]:   <uuid>7cbb27a2-37c5-4045-a005-719f79f30714</uuid>
Oct 26 17:07:47 user nova-compute[75113]:   <name>instance-0000001c</name>
Oct 26 17:07:47 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:07:47 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:07:47 user nova-compute[75113]:   <metadata>
Oct 26 17:07:47 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:07:47 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:07:47 user nova-compute[75113]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-37723291</nova:name>
Oct 26 17:07:47 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:07:47</nova:creationTime>
Oct 26 17:07:47 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:07:47 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:07:47 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:07:47 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:07:47 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:07:47 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:07:47 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:07:47 user nova-compute[75113]:       <nova:owner>
Oct 26 17:07:47 user nova-compute[75113]:         <nova:user uuid="c431350f06fd4dbf8d74835f34626ee7">tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member</nova:user>
Oct 26 17:07:47 user nova-compute[75113]:         <nova:project uuid="9ae5d124cb054dfbbe04433a685903bc">tempest-ServerBootFromVolumeStableRescueTest-2080298495</nova:project>
Oct 26 17:07:47 user nova-compute[75113]:       </nova:owner>
Oct 26 17:07:47 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:07:47 user nova-compute[75113]:       <nova:ports>
Oct 26 17:07:47 user nova-compute[75113]:         <nova:port uuid="9423387c-270f-462d-bae1-c28813953dc9">
Oct 26 17:07:47 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 17:07:47 user nova-compute[75113]:         </nova:port>
Oct 26 17:07:47 user nova-compute[75113]:       </nova:ports>
Oct 26 17:07:47 user nova-compute[75113]:     </nova:instance>
Oct 26 17:07:47 user nova-compute[75113]:   </metadata>
Oct 26 17:07:47 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:07:47 user nova-compute[75113]:     <system>
Oct 26 17:07:47 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:07:47 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:07:47 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:07:47 user nova-compute[75113]:       <entry name="serial">7cbb27a2-37c5-4045-a005-719f79f30714</entry>
Oct 26 17:07:47 user nova-compute[75113]:       <entry name="uuid">7cbb27a2-37c5-4045-a005-719f79f30714</entry>
Oct 26 17:07:47 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:07:47 user nova-compute[75113]:     </system>
Oct 26 17:07:47 user nova-compute[75113]:   </sysinfo>
Oct 26 17:07:47 user nova-compute[75113]:   <os>
Oct 26 17:07:47 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:07:47 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:07:47 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:07:47 user nova-compute[75113]:   </os>
Oct 26 17:07:47 user nova-compute[75113]:   <features>
Oct 26 17:07:47 user nova-compute[75113]:     <acpi/>
Oct 26 17:07:47 user nova-compute[75113]:     <apic/>
Oct 26 17:07:47 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:07:47 user nova-compute[75113]:   </features>
Oct 26 17:07:47 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:07:47 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:07:47 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:07:47 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:07:47 user nova-compute[75113]:   </clock>
Oct 26 17:07:47 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:07:47 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:07:47 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:07:47 user nova-compute[75113]:   </cpu>
Oct 26 17:07:47 user nova-compute[75113]:   <devices>
Oct 26 17:07:47 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:07:47 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:07:47 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk"/>
Oct 26 17:07:47 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:07:47 user nova-compute[75113]:     </disk>
Oct 26 17:07:47 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:07:47 user nova-compute[75113]:       <mac address="fa:16:3e:ab:e3:d2"/>
Oct 26 17:07:47 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:07:47 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:07:47 user nova-compute[75113]:       <target dev="tap9423387c-27"/>
Oct 26 17:07:47 user nova-compute[75113]:     </interface>
Oct 26 17:07:47 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:07:47 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/console.log" append="off"/>
Oct 26 17:07:47 user nova-compute[75113]:     </serial>
Oct 26 17:07:47 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:07:47 user nova-compute[75113]:     <video>
Oct 26 17:07:47 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:07:47 user nova-compute[75113]:     </video>
Oct 26 17:07:47 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:07:47 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:07:47 user nova-compute[75113]:     </rng>
Oct 26 17:07:47 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:07:47 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:07:47 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:07:47 user nova-compute[75113]:     </memballoon>
Oct 26 17:07:47 user nova-compute[75113]:   </devices>
Oct 26 17:07:47 user nova-compute[75113]: </domain>
Oct 26 17:07:47 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-37723291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-37723291',id=28,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-b6ygjdbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:07:46Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=7cbb27a2-37c5-4045-a005-719f79f30714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9423387c-270f-462d-bae1-c28813953dc9", "address": "fa:16:3e:ab:e3:d2", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9423387c-27", "ovs_interfaceid": "9423387c-270f-462d-bae1-c28813953dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "9423387c-270f-462d-bae1-c28813953dc9", "address": "fa:16:3e:ab:e3:d2", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9423387c-27", "ovs_interfaceid": "9423387c-270f-462d-bae1-c28813953dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:e3:d2,bridge_name='br-int',has_traffic_filtering=True,id=9423387c-270f-462d-bae1-c28813953dc9,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9423387c-27') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG os_vif [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:e3:d2,bridge_name='br-int',has_traffic_filtering=True,id=9423387c-270f-462d-bae1-c28813953dc9,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9423387c-27') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b69ae59-e43a-56c8-bb7b-bf95ea967b11', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9423387c-27, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9423387c-27, col_values=(('qos', UUID('648c932f-369f-41e2-8c40-7f2e0b9a3ffb')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9423387c-27, col_values=(('external_ids', {'iface-id': '9423387c-270f-462d-bae1-c28813953dc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:e3:d2', 'vm-uuid': '7cbb27a2-37c5-4045-a005-719f79f30714'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:47 user nova-compute[75113]: INFO os_vif [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:e3:d2,bridge_name='br-int',has_traffic_filtering=True,id=9423387c-270f-462d-bae1-c28813953dc9,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9423387c-27')
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:07:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No VIF found with MAC fa:16:3e:ab:e3:d2, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:07:48 user nova-compute[75113]: DEBUG nova.network.neutron [req-55bb2e7a-5e47-40de-a561-e051caf63266 req-448c0876-cf3c-489c-8fd1-8da8b09774bd service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Updated VIF entry in instance network info cache for port 9423387c-270f-462d-bae1-c28813953dc9. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:07:48 user nova-compute[75113]: DEBUG nova.network.neutron [req-55bb2e7a-5e47-40de-a561-e051caf63266 req-448c0876-cf3c-489c-8fd1-8da8b09774bd service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Updating instance_info_cache with network_info: [{"id": "9423387c-270f-462d-bae1-c28813953dc9", "address": "fa:16:3e:ab:e3:d2", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9423387c-27", "ovs_interfaceid": "9423387c-270f-462d-bae1-c28813953dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:07:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55bb2e7a-5e47-40de-a561-e051caf63266 req-448c0876-cf3c-489c-8fd1-8da8b09774bd service nova] Releasing lock "refresh_cache-7cbb27a2-37c5-4045-a005-719f79f30714" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:07:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-78f0f25f-d9e0-4cc7-bf27-99878d14c2cd req-5220f4d2-fb13-45bb-953d-ba9324085f74 service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Received event network-vif-plugged-9423387c-270f-462d-bae1-c28813953dc9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:07:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-78f0f25f-d9e0-4cc7-bf27-99878d14c2cd req-5220f4d2-fb13-45bb-953d-ba9324085f74 service nova] Acquiring lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-78f0f25f-d9e0-4cc7-bf27-99878d14c2cd req-5220f4d2-fb13-45bb-953d-ba9324085f74 service nova] Lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-78f0f25f-d9e0-4cc7-bf27-99878d14c2cd req-5220f4d2-fb13-45bb-953d-ba9324085f74 service nova] Lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-78f0f25f-d9e0-4cc7-bf27-99878d14c2cd req-5220f4d2-fb13-45bb-953d-ba9324085f74 service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] No waiting events found dispatching network-vif-plugged-9423387c-270f-462d-bae1-c28813953dc9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:07:49 user nova-compute[75113]: WARNING nova.compute.manager [req-78f0f25f-d9e0-4cc7-bf27-99878d14c2cd req-5220f4d2-fb13-45bb-953d-ba9324085f74 service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Received unexpected event network-vif-plugged-9423387c-270f-462d-bae1-c28813953dc9 for instance with vm_state building and task_state spawning.
Oct 26 17:07:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-1f39a9bf-3120-4fa2-bbbf-e878747e1104 req-9c9a763f-939e-42af-a04f-647e6b821f3f service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Received event network-vif-plugged-9423387c-270f-462d-bae1-c28813953dc9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:07:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1f39a9bf-3120-4fa2-bbbf-e878747e1104 req-9c9a763f-939e-42af-a04f-647e6b821f3f service nova] Acquiring lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1f39a9bf-3120-4fa2-bbbf-e878747e1104 req-9c9a763f-939e-42af-a04f-647e6b821f3f service nova] Lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1f39a9bf-3120-4fa2-bbbf-e878747e1104 req-9c9a763f-939e-42af-a04f-647e6b821f3f service nova] Lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-1f39a9bf-3120-4fa2-bbbf-e878747e1104 req-9c9a763f-939e-42af-a04f-647e6b821f3f service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] No waiting events found dispatching network-vif-plugged-9423387c-270f-462d-bae1-c28813953dc9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:07:51 user nova-compute[75113]: WARNING nova.compute.manager [req-1f39a9bf-3120-4fa2-bbbf-e878747e1104 req-9c9a763f-939e-42af-a04f-647e6b821f3f service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Received unexpected event network-vif-plugged-9423387c-270f-462d-bae1-c28813953dc9 for instance with vm_state building and task_state spawning.
Oct 26 17:07:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:07:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:07:52 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Instance spawned successfully.
Oct 26 17:07:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:07:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:07:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:07:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:07:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:07:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:07:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:07:52 user nova-compute[75113]: INFO nova.compute.manager [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Took 6.30 seconds to spawn the instance on the hypervisor.
Oct 26 17:07:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:07:52 user nova-compute[75113]: INFO nova.compute.manager [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Took 7.12 seconds to build instance.
Oct 26 17:07:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b389b6e4-7619-4f7b-a2cc-8c89b17e20a8 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "7cbb27a2-37c5-4045-a005-719f79f30714" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.235s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:53 user nova-compute[75113]: INFO nova.compute.manager [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Rescuing
Oct 26 17:07:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:07:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquired lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:07:53 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:07:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:54 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Updating instance_info_cache with network_info: [{"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:07:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Releasing lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:07:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:55 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Instance destroyed successfully.
Oct 26 17:07:55 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Attempting rescue
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75113) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Instance directory exists: not creating {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 17:07:55 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Creating image(s)
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "/opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "/opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'trusted_certs' on Instance uuid bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.objects.instance [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'flavor' on Instance uuid b5a937c5-26b1-42a2-ad61-660e66688cf8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.rescue {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.rescue" returned: 0 in 0.067s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'migration_context' on Instance uuid bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.objects.base [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Start _get_guest_xml network_info=[{"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "vif_mac": "fa:16:3e:9e:d5:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '91603055-2c31-464d-bb00-ae160ab6e467', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'resources' on Instance uuid bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:55 user nova-compute[75113]: INFO nova.compute.manager [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Attaching volume c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc to /dev/vdb
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.objects.base [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'numa_topology' on Instance uuid bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.objects.base [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:07:55 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:07:55 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'vcpu_model' on Instance uuid bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.objects.base [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1018610013',display_name='tempest-ServerRescueNegativeTestJSON-server-1018610013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1018610013',id=23,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:03:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d11c5d88b2f4a45acee2e9c7d26043a',ramdisk_id='',reservation_id='r-z45ooa2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760587308',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760587308-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:03:16Z,user_data=None,user_id='5aa8e21aab014ce6ace0109878275b8f',uuid=bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "vif_mac": "fa:16:3e:9e:d5:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converting VIF {"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "vif_mac": "fa:16:3e:9e:d5:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=a5db72c5-5814-4a7d-850b-3cc9292bf6d1,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5db72c5-58') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'pci_devices' on Instance uuid bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG os_brick.utils [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.objects.base [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:07:55 user nova-compute[75113]:   <uuid>bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df</uuid>
Oct 26 17:07:55 user nova-compute[75113]:   <name>instance-00000017</name>
Oct 26 17:07:55 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:07:55 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:07:55 user nova-compute[75113]:   <metadata>
Oct 26 17:07:55 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:07:55 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:07:55 user nova-compute[75113]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1018610013</nova:name>
Oct 26 17:07:55 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:07:55</nova:creationTime>
Oct 26 17:07:55 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:07:55 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:07:55 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:07:55 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:07:55 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:07:55 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:07:55 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:07:55 user nova-compute[75113]:       <nova:owner>
Oct 26 17:07:55 user nova-compute[75113]:         <nova:user uuid="5aa8e21aab014ce6ace0109878275b8f">tempest-ServerRescueNegativeTestJSON-1760587308-project-member</nova:user>
Oct 26 17:07:55 user nova-compute[75113]:         <nova:project uuid="2d11c5d88b2f4a45acee2e9c7d26043a">tempest-ServerRescueNegativeTestJSON-1760587308</nova:project>
Oct 26 17:07:55 user nova-compute[75113]:       </nova:owner>
Oct 26 17:07:55 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:07:55 user nova-compute[75113]:       <nova:ports>
Oct 26 17:07:55 user nova-compute[75113]:         <nova:port uuid="a5db72c5-5814-4a7d-850b-3cc9292bf6d1">
Oct 26 17:07:55 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 17:07:55 user nova-compute[75113]:         </nova:port>
Oct 26 17:07:55 user nova-compute[75113]:       </nova:ports>
Oct 26 17:07:55 user nova-compute[75113]:     </nova:instance>
Oct 26 17:07:55 user nova-compute[75113]:   </metadata>
Oct 26 17:07:55 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:07:55 user nova-compute[75113]:     <system>
Oct 26 17:07:55 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:07:55 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:07:55 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:07:55 user nova-compute[75113]:       <entry name="serial">bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df</entry>
Oct 26 17:07:55 user nova-compute[75113]:       <entry name="uuid">bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df</entry>
Oct 26 17:07:55 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:07:55 user nova-compute[75113]:     </system>
Oct 26 17:07:55 user nova-compute[75113]:   </sysinfo>
Oct 26 17:07:55 user nova-compute[75113]:   <os>
Oct 26 17:07:55 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:07:55 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:07:55 user nova-compute[75113]:   </os>
Oct 26 17:07:55 user nova-compute[75113]:   <features>
Oct 26 17:07:55 user nova-compute[75113]:     <acpi/>
Oct 26 17:07:55 user nova-compute[75113]:     <apic/>
Oct 26 17:07:55 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:07:55 user nova-compute[75113]:   </features>
Oct 26 17:07:55 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:07:55 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:07:55 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:07:55 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:07:55 user nova-compute[75113]:   </clock>
Oct 26 17:07:55 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:07:55 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:07:55 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:07:55 user nova-compute[75113]:   </cpu>
Oct 26 17:07:55 user nova-compute[75113]:   <devices>
Oct 26 17:07:55 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:07:55 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:07:55 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.rescue"/>
Oct 26 17:07:55 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:07:55 user nova-compute[75113]:     </disk>
Oct 26 17:07:55 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:07:55 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:07:55 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk"/>
Oct 26 17:07:55 user nova-compute[75113]:       <target dev="vdb" bus="virtio"/>
Oct 26 17:07:55 user nova-compute[75113]:     </disk>
Oct 26 17:07:55 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:07:55 user nova-compute[75113]:       <mac address="fa:16:3e:9e:d5:a5"/>
Oct 26 17:07:55 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:07:55 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:07:55 user nova-compute[75113]:       <target dev="tapa5db72c5-58"/>
Oct 26 17:07:55 user nova-compute[75113]:     </interface>
Oct 26 17:07:55 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:07:55 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/console.log" append="off"/>
Oct 26 17:07:55 user nova-compute[75113]:     </serial>
Oct 26 17:07:55 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:07:55 user nova-compute[75113]:     <video>
Oct 26 17:07:55 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:07:55 user nova-compute[75113]:     </video>
Oct 26 17:07:55 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:07:55 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:07:55 user nova-compute[75113]:     </rng>
Oct 26 17:07:55 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:07:55 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:07:55 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:07:55 user nova-compute[75113]:     </memballoon>
Oct 26 17:07:55 user nova-compute[75113]:   </devices>
Oct 26 17:07:55 user nova-compute[75113]: </domain>
Oct 26 17:07:55 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[67394557-adc7-4ba1-96f5-c4aa0f427f27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:55 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Instance destroyed successfully.
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfb4802-f7ec-4ef3-a4db-305ee4a06c31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a977611-193e-4aaf-b7a5-0c0bc7d47189]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9780c82-530f-4c1f-af85-de352437b5d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No VIF found with MAC fa:16:3e:9e:d5:a5, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:07:55 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:07:55 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea3790a-c4d2-48f1-9eb3-6d4839030a60]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG os_brick.utils [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:07:55 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updating existing volume attachment record: 956ba4e9-b782-4771-9e74-f5e110f21285 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:07:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-a1facd23-9e23-433f-8ea6-5832fe80c0f1 req-6e60b616-8917-45f3-b1ec-a33f72b0fa4d service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-unplugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:07:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a1facd23-9e23-433f-8ea6-5832fe80c0f1 req-6e60b616-8917-45f3-b1ec-a33f72b0fa4d service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a1facd23-9e23-433f-8ea6-5832fe80c0f1 req-6e60b616-8917-45f3-b1ec-a33f72b0fa4d service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a1facd23-9e23-433f-8ea6-5832fe80c0f1 req-6e60b616-8917-45f3-b1ec-a33f72b0fa4d service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-a1facd23-9e23-433f-8ea6-5832fe80c0f1 req-6e60b616-8917-45f3-b1ec-a33f72b0fa4d service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-unplugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:07:56 user nova-compute[75113]: WARNING nova.compute.manager [req-a1facd23-9e23-433f-8ea6-5832fe80c0f1 req-6e60b616-8917-45f3-b1ec-a33f72b0fa4d service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-unplugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state active and task_state rescuing.
Oct 26 17:07:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:07:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:07:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:07:58 user nova-compute[75113]: WARNING nova.compute.manager [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state active and task_state rescuing.
Oct 26 17:07:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:07:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:07:58 user nova-compute[75113]: WARNING nova.compute.manager [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state active and task_state rescuing.
Oct 26 17:07:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:07:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:07:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:07:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:07:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:07:58 user nova-compute[75113]: WARNING nova.compute.manager [req-826d2886-5cd5-4af3-9917-93c33074495e req-de90ccc0-ea64-497a-bd06-ddbbe28b278f service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state active and task_state rescuing.
Oct 26 17:07:59 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4a7ef6c6-a740-4943-988a-f510296c8d39 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:08:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:08:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:08:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "f60b73c6-56d5-4d90-828e-d65ced84bbda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:03 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:08:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:08:03 user nova-compute[75113]: INFO nova.compute.claims [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Claim successful on node user
Oct 26 17:08:04 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:08:04 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:08:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:08:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:08:04 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:08:04 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:08:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:08:04 user nova-compute[75113]: DEBUG nova.policy [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3eeb783dc1e94ccfb8780b90eee807cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47d3d39dd024c499cf74b858d146af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:08:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:08:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:08:04 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Creating image(s)
Oct 26 17:08:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "/opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "/opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "/opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.209s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.202s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk 1073741824" returned: 0 in 0.060s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Successfully created port: babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-b07d5f6f-8994-46a8-8c80-c0b803c894b0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-b07d5f6f-8994-46a8-8c80-c0b803c894b0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.223s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Cannot resize image /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Ensure instance console log exists: /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Updating instance_info_cache with network_info: [{"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-b07d5f6f-8994-46a8-8c80-c0b803c894b0" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Successfully updated port: babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "refresh_cache-f60b73c6-56d5-4d90-828e-d65ced84bbda" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquired lock "refresh_cache-f60b73c6-56d5-4d90-828e-d65ced84bbda" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-752c38af-8ecb-4a03-9c22-f95bec608e9a req-a568a3b9-14a3-4ac4-8614-aa57924ed177 service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Received event network-changed-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-752c38af-8ecb-4a03-9c22-f95bec608e9a req-a568a3b9-14a3-4ac4-8614-aa57924ed177 service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Refreshing instance network info cache due to event network-changed-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-752c38af-8ecb-4a03-9c22-f95bec608e9a req-a568a3b9-14a3-4ac4-8614-aa57924ed177 service nova] Acquiring lock "refresh_cache-f60b73c6-56d5-4d90-828e-d65ced84bbda" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Updating instance_info_cache with network_info: [{"id": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "address": "fa:16:3e:0d:10:47", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabf2c9f-f3", "ovs_interfaceid": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Releasing lock "refresh_cache-f60b73c6-56d5-4d90-828e-d65ced84bbda" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Instance network_info: |[{"id": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "address": "fa:16:3e:0d:10:47", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabf2c9f-f3", "ovs_interfaceid": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-752c38af-8ecb-4a03-9c22-f95bec608e9a req-a568a3b9-14a3-4ac4-8614-aa57924ed177 service nova] Acquired lock "refresh_cache-f60b73c6-56d5-4d90-828e-d65ced84bbda" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.network.neutron [req-752c38af-8ecb-4a03-9c22-f95bec608e9a req-a568a3b9-14a3-4ac4-8614-aa57924ed177 service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Refreshing network info cache for port babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Start _get_guest_xml network_info=[{"id": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "address": "fa:16:3e:0d:10:47", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabf2c9f-f3", "ovs_interfaceid": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:08:06 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:08:06 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-787962727',display_name='tempest-VolumesActionsTest-instance-787962727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-787962727',id=29,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f47d3d39dd024c499cf74b858d146af8',ramdisk_id='',reservation_id='r-etw100z2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-152632718',owner_user_name='tempest-VolumesActionsTest-152632718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:08:05Z,user_data=None,user_id='3eeb783dc1e94ccfb8780b90eee807cf',uuid=f60b73c6-56d5-4d90-828e-d65ced84bbda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "address": "fa:16:3e:0d:10:47", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabf2c9f-f3", "ovs_interfaceid": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Converting VIF {"id": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "address": "fa:16:3e:0d:10:47", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabf2c9f-f3", "ovs_interfaceid": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:10:47,bridge_name='br-int',has_traffic_filtering=True,id=babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabf2c9f-f3') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lazy-loading 'pci_devices' on Instance uuid f60b73c6-56d5-4d90-828e-d65ced84bbda {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:08:06 user nova-compute[75113]:   <uuid>f60b73c6-56d5-4d90-828e-d65ced84bbda</uuid>
Oct 26 17:08:06 user nova-compute[75113]:   <name>instance-0000001d</name>
Oct 26 17:08:06 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:08:06 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:08:06 user nova-compute[75113]:   <metadata>
Oct 26 17:08:06 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:08:06 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:08:06 user nova-compute[75113]:       <nova:name>tempest-VolumesActionsTest-instance-787962727</nova:name>
Oct 26 17:08:06 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:08:06</nova:creationTime>
Oct 26 17:08:06 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:08:06 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:08:06 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:08:06 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:08:06 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:08:06 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:08:06 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:08:06 user nova-compute[75113]:       <nova:owner>
Oct 26 17:08:06 user nova-compute[75113]:         <nova:user uuid="3eeb783dc1e94ccfb8780b90eee807cf">tempest-VolumesActionsTest-152632718-project-member</nova:user>
Oct 26 17:08:06 user nova-compute[75113]:         <nova:project uuid="f47d3d39dd024c499cf74b858d146af8">tempest-VolumesActionsTest-152632718</nova:project>
Oct 26 17:08:06 user nova-compute[75113]:       </nova:owner>
Oct 26 17:08:06 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:08:06 user nova-compute[75113]:       <nova:ports>
Oct 26 17:08:06 user nova-compute[75113]:         <nova:port uuid="babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1">
Oct 26 17:08:06 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 17:08:06 user nova-compute[75113]:         </nova:port>
Oct 26 17:08:06 user nova-compute[75113]:       </nova:ports>
Oct 26 17:08:06 user nova-compute[75113]:     </nova:instance>
Oct 26 17:08:06 user nova-compute[75113]:   </metadata>
Oct 26 17:08:06 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:08:06 user nova-compute[75113]:     <system>
Oct 26 17:08:06 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:08:06 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:08:06 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:08:06 user nova-compute[75113]:       <entry name="serial">f60b73c6-56d5-4d90-828e-d65ced84bbda</entry>
Oct 26 17:08:06 user nova-compute[75113]:       <entry name="uuid">f60b73c6-56d5-4d90-828e-d65ced84bbda</entry>
Oct 26 17:08:06 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:08:06 user nova-compute[75113]:     </system>
Oct 26 17:08:06 user nova-compute[75113]:   </sysinfo>
Oct 26 17:08:06 user nova-compute[75113]:   <os>
Oct 26 17:08:06 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:08:06 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:08:06 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:08:06 user nova-compute[75113]:   </os>
Oct 26 17:08:06 user nova-compute[75113]:   <features>
Oct 26 17:08:06 user nova-compute[75113]:     <acpi/>
Oct 26 17:08:06 user nova-compute[75113]:     <apic/>
Oct 26 17:08:06 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:08:06 user nova-compute[75113]:   </features>
Oct 26 17:08:06 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:08:06 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:08:06 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:08:06 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:08:06 user nova-compute[75113]:   </clock>
Oct 26 17:08:06 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:08:06 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:08:06 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:08:06 user nova-compute[75113]:   </cpu>
Oct 26 17:08:06 user nova-compute[75113]:   <devices>
Oct 26 17:08:06 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:08:06 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:08:06 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk"/>
Oct 26 17:08:06 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:08:06 user nova-compute[75113]:     </disk>
Oct 26 17:08:06 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:08:06 user nova-compute[75113]:       <mac address="fa:16:3e:0d:10:47"/>
Oct 26 17:08:06 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:08:06 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:08:06 user nova-compute[75113]:       <target dev="tapbabf2c9f-f3"/>
Oct 26 17:08:06 user nova-compute[75113]:     </interface>
Oct 26 17:08:06 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:08:06 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/console.log" append="off"/>
Oct 26 17:08:06 user nova-compute[75113]:     </serial>
Oct 26 17:08:06 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:08:06 user nova-compute[75113]:     <video>
Oct 26 17:08:06 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:08:06 user nova-compute[75113]:     </video>
Oct 26 17:08:06 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:08:06 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:08:06 user nova-compute[75113]:     </rng>
Oct 26 17:08:06 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:08:06 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:08:06 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:08:06 user nova-compute[75113]:     </memballoon>
Oct 26 17:08:06 user nova-compute[75113]:   </devices>
Oct 26 17:08:06 user nova-compute[75113]: </domain>
Oct 26 17:08:06 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-787962727',display_name='tempest-VolumesActionsTest-instance-787962727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-787962727',id=29,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f47d3d39dd024c499cf74b858d146af8',ramdisk_id='',reservation_id='r-etw100z2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-152632718',owner_user_name='tempest-VolumesActionsTest-152632718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:08:05Z,user_data=None,user_id='3eeb783dc1e94ccfb8780b90eee807cf',uuid=f60b73c6-56d5-4d90-828e-d65ced84bbda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "address": "fa:16:3e:0d:10:47", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabf2c9f-f3", "ovs_interfaceid": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Converting VIF {"id": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "address": "fa:16:3e:0d:10:47", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabf2c9f-f3", "ovs_interfaceid": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:10:47,bridge_name='br-int',has_traffic_filtering=True,id=babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabf2c9f-f3') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG os_vif [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:10:47,bridge_name='br-int',has_traffic_filtering=True,id=babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabf2c9f-f3') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62fee032-bb38-5769-96fe-c19e31504f96', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbabf2c9f-f3, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbabf2c9f-f3, col_values=(('qos', UUID('d8ba96c7-5236-4b8c-af8e-d99d1d271f8b')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbabf2c9f-f3, col_values=(('external_ids', {'iface-id': 'babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:10:47', 'vm-uuid': 'f60b73c6-56d5-4d90-828e-d65ced84bbda'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:08:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:06 user nova-compute[75113]: INFO os_vif [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:10:47,bridge_name='br-int',has_traffic_filtering=True,id=babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabf2c9f-f3')
Oct 26 17:08:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] No VIF found with MAC fa:16:3e:0d:10:47, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "37683519-d90a-4fa4-8e8f-cc883a2573ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:07 user nova-compute[75113]: INFO nova.compute.manager [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Terminating instance
Oct 26 17:08:07 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG nova.network.neutron [req-752c38af-8ecb-4a03-9c22-f95bec608e9a req-a568a3b9-14a3-4ac4-8614-aa57924ed177 service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Updated VIF entry in instance network info cache for port babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG nova.network.neutron [req-752c38af-8ecb-4a03-9c22-f95bec608e9a req-a568a3b9-14a3-4ac4-8614-aa57924ed177 service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Updating instance_info_cache with network_info: [{"id": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "address": "fa:16:3e:0d:10:47", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabf2c9f-f3", "ovs_interfaceid": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-752c38af-8ecb-4a03-9c22-f95bec608e9a req-a568a3b9-14a3-4ac4-8614-aa57924ed177 service nova] Releasing lock "refresh_cache-f60b73c6-56d5-4d90-828e-d65ced84bbda" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-878e1164-b08c-458c-a184-94bbf2b2fd98 req-3d6abc8c-2900-43c3-b208-9f56eb3aef7f service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received event network-vif-unplugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-878e1164-b08c-458c-a184-94bbf2b2fd98 req-3d6abc8c-2900-43c3-b208-9f56eb3aef7f service nova] Acquiring lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-878e1164-b08c-458c-a184-94bbf2b2fd98 req-3d6abc8c-2900-43c3-b208-9f56eb3aef7f service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-878e1164-b08c-458c-a184-94bbf2b2fd98 req-3d6abc8c-2900-43c3-b208-9f56eb3aef7f service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-878e1164-b08c-458c-a184-94bbf2b2fd98 req-3d6abc8c-2900-43c3-b208-9f56eb3aef7f service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] No waiting events found dispatching network-vif-unplugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:08:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-878e1164-b08c-458c-a184-94bbf2b2fd98 req-3d6abc8c-2900-43c3-b208-9f56eb3aef7f service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received event network-vif-unplugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:08:08 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Instance destroyed successfully.
Oct 26 17:08:08 user nova-compute[75113]: DEBUG nova.objects.instance [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lazy-loading 'resources' on Instance uuid 37683519-d90a-4fa4-8e8f-cc883a2573ac {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-208554010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1698414037',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdPVR8jrmmvs+FA1zsu8BhsOGQFKaF3g3dbAYbTOUQUphGdHDb5ZBl+LTAW9kwLngnlZjZt/Fup1ZMGDest0Syvi7iB20PUTksvIR3dTjbbM0POZ2eFVo0aHjgMG+Kq4A==',key_name='tempest-keypair-352373129',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:06:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71e3ef36922d4fb7902344a5e66d9941',ramdisk_id='',reservation_id='r-vdp0td0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1360395865',owner_user_name='tempest-ServerActionsV293TestJSON-1360395865-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9de31526e7d049c0933bd981347ad67b',uuid=37683519-d90a-4fa4-8e8f-cc883a2573ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Converting VIF {"id": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "address": "fa:16:3e:a2:c2:3a", "network": {"id": "aff597f5-d5a2-43fb-9581-57dcb48f6e9e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-811584641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e3ef36922d4fb7902344a5e66d9941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e20a2e-c0", "ovs_interfaceid": "d7e20a2e-c0b5-4551-bc13-e3ef233eae81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG os_vif [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7e20a2e-c0, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb2d29f3-7ae0-42b6-958c-802dc06f85f3) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:08:08 user nova-compute[75113]: INFO os_vif [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81,network=Network(aff597f5-d5a2-43fb-9581-57dcb48f6e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e20a2e-c0')
Oct 26 17:08:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNKpJYag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:08:08 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:08:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a896f63-1045-4034-95d7-6d79081c1b24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:08:08 user nova-compute[75113]: No targets found.
Oct 26 17:08:08 user nova-compute[75113]: iSNS:
Oct 26 17:08:08 user nova-compute[75113]: No targets found.
Oct 26 17:08:08 user nova-compute[75113]: STATIC:
Oct 26 17:08:08 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804
Oct 26 17:08:08 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:08:08 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:08:08 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:08:08 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:08:08 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:08:08 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24
Oct 26 17:08:08 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:08:08 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:08:08 user nova-compute[75113]: FIRMWARE:
Oct 26 17:08:08 user nova-compute[75113]: No targets found.
Oct 26 17:08:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:08:08 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:08:08 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe33061-05b8-407f-b3a1-672bb779a9aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e5413e-5b9b-4a41-b077-80239c3e5590]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:08:08 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:08:08 user nova-compute[75113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:08:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:08:08 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:08:08 user nova-compute[75113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 (non-flash)
Oct 26 17:08:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493b8de440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24'): ({'sde'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Removing single pathed devices sde {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[287cf1ac-9f1c-4554-bfd4-d71c55001d50]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd9b323-c178-4b36-8c6b-002c7ee4d8cb]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Flushing IO for device /dev/sde {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.031s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d0e115-b23e-4fb0-8c3b-bd0723cca33d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:08:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.069s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cce64d7-052a-485d-bf8f-dbbdabf18ea7]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0a04be-1418-494f-932d-3e0749b0be9b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f39b484-d36e-4299-83be-9b7db946c471]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260]
Oct 26 17:08:09 user nova-compute[75113]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24, portal: 172.16.0.220,3260] successful.
Oct 26 17:08:09 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de619a-4ee3-47dd-8780-dd158767fe24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2029cdc-894c-45bc-8805-98db579c6201]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] <== disconnect_volume: return (406ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:08:09 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Deleting instance files /opt/stack/data/nova/instances/37683519-d90a-4fa4-8e8f-cc883a2573ac_del
Oct 26 17:08:09 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Deletion of /opt/stack/data/nova/instances/37683519-d90a-4fa4-8e8f-cc883a2573ac_del complete
Oct 26 17:08:09 user nova-compute[75113]: INFO nova.compute.manager [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Took 2.03 seconds to destroy the instance on the hypervisor.
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received event network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] Acquiring lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] No waiting events found dispatching network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:08:09 user nova-compute[75113]: WARNING nova.compute.manager [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received unexpected event network-vif-plugged-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 for instance with vm_state active and task_state deleting.
Oct 26 17:08:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Received event network-vif-plugged-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] Acquiring lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] No waiting events found dispatching network-vif-plugged-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:08:09 user nova-compute[75113]: WARNING nova.compute.manager [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Received unexpected event network-vif-plugged-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 for instance with vm_state building and task_state spawning.
Oct 26 17:08:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Received event network-vif-plugged-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] Acquiring lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] No waiting events found dispatching network-vif-plugged-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:08:09 user nova-compute[75113]: WARNING nova.compute.manager [req-e9b1e327-c91d-4fef-8716-e0b87e733ddf req-778646f0-c969-4112-8b4a-c08afd20e011 service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Received unexpected event network-vif-plugged-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 for instance with vm_state building and task_state spawning.
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:08:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:10 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:08:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-31c1a79d-2f3b-4094-a6b7-d5a052427517 req-ae37a47a-79e8-4c4d-a6c4-7ede9be4c0f1 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Received event network-vif-deleted-d7e20a2e-c0b5-4551-bc13-e3ef233eae81 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:08:10 user nova-compute[75113]: INFO nova.compute.manager [req-31c1a79d-2f3b-4094-a6b7-d5a052427517 req-ae37a47a-79e8-4c4d-a6c4-7ede9be4c0f1 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Neutron deleted interface d7e20a2e-c0b5-4551-bc13-e3ef233eae81; detaching it from the instance and deleting it from the info cache
Oct 26 17:08:10 user nova-compute[75113]: DEBUG nova.network.neutron [req-31c1a79d-2f3b-4094-a6b7-d5a052427517 req-ae37a47a-79e8-4c4d-a6c4-7ede9be4c0f1 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:08:10 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Took 1.01 seconds to deallocate network for instance.
Oct 26 17:08:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-31c1a79d-2f3b-4094-a6b7-d5a052427517 req-ae37a47a-79e8-4c4d-a6c4-7ede9be4c0f1 service nova] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Detach interface failed, port_id=d7e20a2e-c0b5-4551-bc13-e3ef233eae81, reason: Instance 37683519-d90a-4fa4-8e8f-cc883a2573ac could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:08:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:11 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Instance spawned successfully.
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:08:11 user nova-compute[75113]: INFO nova.compute.manager [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Detaching volume 7528c15d-6770-43f0-b1dc-705e7d29f804
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:08:11 user nova-compute[75113]: INFO nova.compute.manager [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Took 0.99 seconds to detach 1 volumes for instance.
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] [instance: 37683519-d90a-4fa4-8e8f-cc883a2573ac] Deleting volume: c2de619a-4ee3-47dd-8780-dd158767fe24 {{(pid=75113) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 17:08:11 user nova-compute[75113]: INFO nova.virt.block_device [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Attempting to driver detach volume 7528c15d-6770-43f0-b1dc-705e7d29f804 from mountpoint /dev/vdb
Oct 26 17:08:11 user nova-compute[75113]: INFO nova.compute.manager [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Took 6.60 seconds to spawn the instance on the hypervisor.
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Attempting to detach device vdb from instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:08:11 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:08:11 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:08:11 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:08:11 user nova-compute[75113]:   <serial>7528c15d-6770-43f0-b1dc-705e7d29f804</serial>
Oct 26 17:08:11 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 17:08:11 user nova-compute[75113]: </disk>
Oct 26 17:08:11 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:08:11 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Successfully detached device vdb from instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 from the persistent domain config.
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:08:11 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:08:11 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:08:11 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:08:11 user nova-compute[75113]:   <serial>7528c15d-6770-43f0-b1dc-705e7d29f804</serial>
Oct 26 17:08:11 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 17:08:11 user nova-compute[75113]: </disk>
Oct 26 17:08:11 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:08:11 user nova-compute[75113]: INFO nova.compute.manager [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Took 7.61 seconds to build instance.
Oct 26 17:08:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4e28ea5c-aa65-4338-b1ca-a7aee122b538 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.773s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:08:11 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:08:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:08:12 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Deleted allocations for instance 37683519-d90a-4fa4-8e8f-cc883a2573ac
Oct 26 17:08:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ea924040-06bc-46d1-a1c8-a33ea278ac35 tempest-ServerActionsV293TestJSON-1360395865 tempest-ServerActionsV293TestJSON-1360395865-project-member] Lock "37683519-d90a-4fa4-8e8f-cc883a2573ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.992s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:15 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:08:15 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7729MB free_disk=25.07461929321289GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b5a937c5-26b1-42a2-ad61-660e66688cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 7cbb27a2-37c5-4045-a005-719f79f30714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance f60b73c6-56d5-4d90-828e-d65ced84bbda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:08:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.630s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QndPgDGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:08:17 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:08:17 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:08:17 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[643e61b2-691d-4cc2-becc-16cce136954e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:08:17 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7b90ea-debb-4e51-8c71-6048e8cf5856]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc] added
Oct 26 17:08:17 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b3e3d5-4493-4e61-85ac-77e2f5fa3fea]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9e4f5d-9bcf-468b-8490-270c0c261e7d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QndPgDGL {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QndPgDGL" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[07acd9a9-d49b-4fe8-9d2d-a52ab03e0e94]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QndPgDGL'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c99523-3256-4fda-b07a-c19e2180ad12]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce00ff6b-dd63-468f-a44a-ec5ba370939b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:08:17 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:08:17 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:08:17 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:08:17 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd14b521-74b6-4359-bea4-7e9692aeb2fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc, portal: 172.16.0.220,3260]
Oct 26 17:08:17 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc, portal: 172.16.0.220,3260] successful.
Oct 26 17:08:17 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[94664ed5-a3ff-490a-8079-cf768b38fc35]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[770f8795-634e-4d43-a58f-e503c51ee534]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:08:18 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:08:18 user nova-compute[75113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc (non-flash)
Oct 26 17:08:18 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:08:18 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:08:18 user nova-compute[75113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc (non-flash)
Oct 26 17:08:18 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa28e165-abd7-4a0b-b731-83dc462b58c4]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:08:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:19 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:08:19 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QndPgDGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:08:19 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:08:19 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23031333439303736', 'path': '/dev/sdc'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:08:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031333439303736', 'path': '/dev/sdc'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:08:19 user nova-compute[75113]: DEBUG nova.objects.instance [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'flavor' on Instance uuid b5a937c5-26b1-42a2-ad61-660e66688cf8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:08:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:08:19 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:08:19 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:08:19 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:08:19 user nova-compute[75113]:   <serial>c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc</serial>
Oct 26 17:08:19 user nova-compute[75113]: </disk>
Oct 26 17:08:19 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:08:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:08:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:08:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] No VIF found with MAC fa:16:3e:68:94:9a, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:08:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e0636eb-f098-49ac-9086-5b9cc9651a8c tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.225s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:22 user nova-compute[75113]: DEBUG nova.compute.manager [req-e15bedac-0347-4605-8fc2-cb5d9815ea3b req-c4b43d6d-dd01-4ad5-bd24-ebc21fd7cbc9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-changed-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:08:22 user nova-compute[75113]: DEBUG nova.compute.manager [req-e15bedac-0347-4605-8fc2-cb5d9815ea3b req-c4b43d6d-dd01-4ad5-bd24-ebc21fd7cbc9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Refreshing instance network info cache due to event network-changed-95e2347e-eaa3-4136-a60c-c31645b50944. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:08:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e15bedac-0347-4605-8fc2-cb5d9815ea3b req-c4b43d6d-dd01-4ad5-bd24-ebc21fd7cbc9 service nova] Acquiring lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:08:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e15bedac-0347-4605-8fc2-cb5d9815ea3b req-c4b43d6d-dd01-4ad5-bd24-ebc21fd7cbc9 service nova] Acquired lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:08:22 user nova-compute[75113]: DEBUG nova.network.neutron [req-e15bedac-0347-4605-8fc2-cb5d9815ea3b req-c4b43d6d-dd01-4ad5-bd24-ebc21fd7cbc9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Refreshing network info cache for port 95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:08:23 user nova-compute[75113]: DEBUG nova.network.neutron [req-e15bedac-0347-4605-8fc2-cb5d9815ea3b req-c4b43d6d-dd01-4ad5-bd24-ebc21fd7cbc9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updated VIF entry in instance network info cache for port 95e2347e-eaa3-4136-a60c-c31645b50944. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:08:23 user nova-compute[75113]: DEBUG nova.network.neutron [req-e15bedac-0347-4605-8fc2-cb5d9815ea3b req-c4b43d6d-dd01-4ad5-bd24-ebc21fd7cbc9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updating instance_info_cache with network_info: [{"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:08:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e15bedac-0347-4605-8fc2-cb5d9815ea3b req-c4b43d6d-dd01-4ad5-bd24-ebc21fd7cbc9 service nova] Releasing lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:08:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-c2b13d6f-a2af-41e5-bfeb-831aca00a514 req-8ca2406a-85db-465b-97b1-391defcd8ce9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-changed-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:08:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-c2b13d6f-a2af-41e5-bfeb-831aca00a514 req-8ca2406a-85db-465b-97b1-391defcd8ce9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Refreshing instance network info cache due to event network-changed-95e2347e-eaa3-4136-a60c-c31645b50944. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:08:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c2b13d6f-a2af-41e5-bfeb-831aca00a514 req-8ca2406a-85db-465b-97b1-391defcd8ce9 service nova] Acquiring lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:08:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c2b13d6f-a2af-41e5-bfeb-831aca00a514 req-8ca2406a-85db-465b-97b1-391defcd8ce9 service nova] Acquired lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:08:25 user nova-compute[75113]: DEBUG nova.network.neutron [req-c2b13d6f-a2af-41e5-bfeb-831aca00a514 req-8ca2406a-85db-465b-97b1-391defcd8ce9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Refreshing network info cache for port 95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:08:25 user nova-compute[75113]: DEBUG nova.network.neutron [req-c2b13d6f-a2af-41e5-bfeb-831aca00a514 req-8ca2406a-85db-465b-97b1-391defcd8ce9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updated VIF entry in instance network info cache for port 95e2347e-eaa3-4136-a60c-c31645b50944. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:08:25 user nova-compute[75113]: DEBUG nova.network.neutron [req-c2b13d6f-a2af-41e5-bfeb-831aca00a514 req-8ca2406a-85db-465b-97b1-391defcd8ce9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updating instance_info_cache with network_info: [{"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:08:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c2b13d6f-a2af-41e5-bfeb-831aca00a514 req-8ca2406a-85db-465b-97b1-391defcd8ce9 service nova] Releasing lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:08:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2db9a5d9-f82e-4701-94df-6872ac6665b7 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2db9a5d9-f82e-4701-94df-6872ac6665b7 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:26 user nova-compute[75113]: INFO nova.compute.manager [None req-2db9a5d9-f82e-4701-94df-6872ac6665b7 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Rebooting instance
Oct 26 17:08:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2db9a5d9-f82e-4701-94df-6872ac6665b7 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:08:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2db9a5d9-f82e-4701-94df-6872ac6665b7 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquired lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:08:26 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2db9a5d9-f82e-4701-94df-6872ac6665b7 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:08:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:27 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2db9a5d9-f82e-4701-94df-6872ac6665b7 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updating instance_info_cache with network_info: [{"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:08:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2db9a5d9-f82e-4701-94df-6872ac6665b7 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Releasing lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:08:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2db9a5d9-f82e-4701-94df-6872ac6665b7 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:08:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-860da7c3-7c07-4ef6-bb8d-2fec06f53def req-b6a6b651-e38f-457f-8b21-a5b9b9db478c service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-vif-unplugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:08:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-860da7c3-7c07-4ef6-bb8d-2fec06f53def req-b6a6b651-e38f-457f-8b21-a5b9b9db478c service nova] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-860da7c3-7c07-4ef6-bb8d-2fec06f53def req-b6a6b651-e38f-457f-8b21-a5b9b9db478c service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-860da7c3-7c07-4ef6-bb8d-2fec06f53def req-b6a6b651-e38f-457f-8b21-a5b9b9db478c service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:29 user nova-compute[75113]: DEBUG nova.compute.manager [req-860da7c3-7c07-4ef6-bb8d-2fec06f53def req-b6a6b651-e38f-457f-8b21-a5b9b9db478c service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] No waiting events found dispatching network-vif-unplugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:08:29 user nova-compute[75113]: WARNING nova.compute.manager [req-860da7c3-7c07-4ef6-bb8d-2fec06f53def req-b6a6b651-e38f-457f-8b21-a5b9b9db478c service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received unexpected event network-vif-unplugged-95e2347e-eaa3-4136-a60c-c31645b50944 for instance with vm_state active and task_state reboot_started.
Oct 26 17:08:30 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2db9a5d9-f82e-4701-94df-6872ac6665b7 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Instance shutdown successfully.
Oct 26 17:08:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:31 user nova-compute[75113]: DEBUG nova.compute.manager [req-e7db3df8-93b5-4fa5-888c-4b9a245a3ecc req-7707db66-5310-4c68-9845-04ebcb5c3a81 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:08:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e7db3df8-93b5-4fa5-888c-4b9a245a3ecc req-7707db66-5310-4c68-9845-04ebcb5c3a81 service nova] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e7db3df8-93b5-4fa5-888c-4b9a245a3ecc req-7707db66-5310-4c68-9845-04ebcb5c3a81 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e7db3df8-93b5-4fa5-888c-4b9a245a3ecc req-7707db66-5310-4c68-9845-04ebcb5c3a81 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:31 user nova-compute[75113]: DEBUG nova.compute.manager [req-e7db3df8-93b5-4fa5-888c-4b9a245a3ecc req-7707db66-5310-4c68-9845-04ebcb5c3a81 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] No waiting events found dispatching network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:08:31 user nova-compute[75113]: WARNING nova.compute.manager [req-e7db3df8-93b5-4fa5-888c-4b9a245a3ecc req-7707db66-5310-4c68-9845-04ebcb5c3a81 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received unexpected event network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 for instance with vm_state active and task_state reboot_started.
Oct 26 17:08:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:32 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 is timed out.
Oct 26 17:08:32 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Successfully detached device vdb from instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 from the live domain config.
Oct 26 17:08:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGlxPWFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:08:32 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[11579329-a863-42d7-8f62-ccee40fa247c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:08:32 user nova-compute[75113]: No targets found.
Oct 26 17:08:32 user nova-compute[75113]: iSNS:
Oct 26 17:08:32 user nova-compute[75113]: No targets found.
Oct 26 17:08:32 user nova-compute[75113]: STATIC:
Oct 26 17:08:32 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804
Oct 26 17:08:32 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:08:32 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:08:32 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:08:32 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:08:32 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:08:32 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc
Oct 26 17:08:32 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:08:32 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:08:32 user nova-compute[75113]: FIRMWARE:
Oct 26 17:08:32 user nova-compute[75113]: No targets found.
Oct 26 17:08:32 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:08:32 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:08:32 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a85032a-50e9-4818-96ae-70bdd70a0a61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd84032-a21c-4f24-83e1-a9fe1321e8d3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:08:32 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:08:32 user nova-compute[75113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc (non-flash)
Oct 26 17:08:32 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:08:32 user nova-compute[75113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 (non-flash)
Oct 26 17:08:32 user nova-compute[75113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc (non-flash)
Oct 26 17:08:32 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49146816c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83f4a38-fb00-446b-976e-b485a96402b6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62c3f56-9797-473c-85a7-ac55dd24872c]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fff8b6-3b29-4694-a81e-c56ca260b633]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e0462c-a64a-4d38-b121-f4627927acd5]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cadab88-32c2-4180-9ab6-0b092d4adbdc]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c895e8-b154-49c2-a08d-43622c33a5ec]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260]
Oct 26 17:08:32 user nova-compute[75113]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804, portal: 172.16.0.220,3260] successful.
Oct 26 17:08:32 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7528c15d-6770-43f0-b1dc-705e7d29f804 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1521a3-33c6-4e5b-938e-56dc56af9c2d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] <== disconnect_volume: return (343ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:08:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:08:33 user nova-compute[75113]: DEBUG nova.objects.instance [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lazy-loading 'flavor' on Instance uuid b07d5f6f-8994-46a8-8c80-c0b803c894b0 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:08:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7f6e3e9a-2e24-42d8-96af-1ee03a88b10d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.234s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-efd6c23f-ae30-4d9a-a3b0-0bfd3f703c54 req-d5a7149a-0b5a-49a6-a204-b6c7ed3e00d0 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:08:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-efd6c23f-ae30-4d9a-a3b0-0bfd3f703c54 req-d5a7149a-0b5a-49a6-a204-b6c7ed3e00d0 service nova] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-efd6c23f-ae30-4d9a-a3b0-0bfd3f703c54 req-d5a7149a-0b5a-49a6-a204-b6c7ed3e00d0 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-efd6c23f-ae30-4d9a-a3b0-0bfd3f703c54 req-d5a7149a-0b5a-49a6-a204-b6c7ed3e00d0 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-efd6c23f-ae30-4d9a-a3b0-0bfd3f703c54 req-d5a7149a-0b5a-49a6-a204-b6c7ed3e00d0 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] No waiting events found dispatching network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:08:33 user nova-compute[75113]: WARNING nova.compute.manager [req-efd6c23f-ae30-4d9a-a3b0-0bfd3f703c54 req-d5a7149a-0b5a-49a6-a204-b6c7ed3e00d0 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received unexpected event network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 for instance with vm_state active and task_state reboot_started.
Oct 26 17:08:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-efd6c23f-ae30-4d9a-a3b0-0bfd3f703c54 req-d5a7149a-0b5a-49a6-a204-b6c7ed3e00d0 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:08:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-efd6c23f-ae30-4d9a-a3b0-0bfd3f703c54 req-d5a7149a-0b5a-49a6-a204-b6c7ed3e00d0 service nova] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:08:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-efd6c23f-ae30-4d9a-a3b0-0bfd3f703c54 req-d5a7149a-0b5a-49a6-a204-b6c7ed3e00d0 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:08:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-efd6c23f-ae30-4d9a-a3b0-0bfd3f703c54 req-d5a7149a-0b5a-49a6-a204-b6c7ed3e00d0 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-efd6c23f-ae30-4d9a-a3b0-0bfd3f703c54 req-d5a7149a-0b5a-49a6-a204-b6c7ed3e00d0 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] No waiting events found dispatching network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:08:33 user nova-compute[75113]: WARNING nova.compute.manager [req-efd6c23f-ae30-4d9a-a3b0-0bfd3f703c54 req-d5a7149a-0b5a-49a6-a204-b6c7ed3e00d0 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received unexpected event network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 for instance with vm_state active and task_state reboot_started.
Oct 26 17:08:33 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Instance running successfully.
Oct 26 17:08:33 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2db9a5d9-f82e-4701-94df-6872ac6665b7 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Instance soft rebooted successfully.
Oct 26 17:08:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2db9a5d9-f82e-4701-94df-6872ac6665b7 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:08:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2db9a5d9-f82e-4701-94df-6872ac6665b7 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.919s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:08:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:08:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:01 user nova-compute[75113]: INFO nova.compute.manager [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Terminating instance
Oct 26 17:09:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-d9c61625-a2dc-4734-bd6d-af7e99f16989 req-5476e325-6a39-4978-bdee-824a8f1a23ea service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received event network-vif-unplugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d9c61625-a2dc-4734-bd6d-af7e99f16989 req-5476e325-6a39-4978-bdee-824a8f1a23ea service nova] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d9c61625-a2dc-4734-bd6d-af7e99f16989 req-5476e325-6a39-4978-bdee-824a8f1a23ea service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d9c61625-a2dc-4734-bd6d-af7e99f16989 req-5476e325-6a39-4978-bdee-824a8f1a23ea service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-d9c61625-a2dc-4734-bd6d-af7e99f16989 req-5476e325-6a39-4978-bdee-824a8f1a23ea service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] No waiting events found dispatching network-vif-unplugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-d9c61625-a2dc-4734-bd6d-af7e99f16989 req-5476e325-6a39-4978-bdee-824a8f1a23ea service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received event network-vif-unplugged-e8551569-369f-4dfc-a57e-c1c06ed135bf for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:02 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Instance destroyed successfully.
Oct 26 17:09:02 user nova-compute[75113]: DEBUG nova.objects.instance [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lazy-loading 'resources' on Instance uuid b07d5f6f-8994-46a8-8c80-c0b803c894b0 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:09:02 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-344642576',display_name='tempest-ServerActionsTestOtherA-server-1923697164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-344642576',id=21,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKDgMEMkpFlH8KZx6RrwYwMvXxYdxXkahHL23zoh9+5s6eqdjgg+Ebr255x4MvsxDhjqzswkbnJBfDeEKclFqpSIgvgAFmGk/YzRnMisxnzZSlJhLo3ijX43KEIBuel7A==',key_name='tempest-keypair-1377389928',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:05:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-hpcm4pye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=b07d5f6f-8994-46a8-8c80-c0b803c894b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:09:02 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "address": "fa:16:3e:ab:4a:42", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8551569-36", "ovs_interfaceid": "e8551569-369f-4dfc-a57e-c1c06ed135bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:09:02 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:09:02 user nova-compute[75113]: DEBUG os_vif [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:09:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8551569-36, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:09:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:09:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fd63a37-0ef9-43a7-b265-2f1188c72600) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:09:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:09:02 user nova-compute[75113]: INFO os_vif [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4a:42,bridge_name='br-int',has_traffic_filtering=True,id=e8551569-369f-4dfc-a57e-c1c06ed135bf,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8551569-36')
Oct 26 17:09:02 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Deleting instance files /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0_del
Oct 26 17:09:02 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Deletion of /opt/stack/data/nova/instances/b07d5f6f-8994-46a8-8c80-c0b803c894b0_del complete
Oct 26 17:09:02 user nova-compute[75113]: INFO nova.compute.manager [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 26 17:09:02 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:09:02 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:09:02 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:09:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:09:03 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:09:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-41e24efd-2f56-4039-876c-ac63f5b66497 req-5df34dc0-ed89-4c5d-b281-46b3095807d8 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received event network-vif-deleted-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:09:03 user nova-compute[75113]: INFO nova.compute.manager [req-41e24efd-2f56-4039-876c-ac63f5b66497 req-5df34dc0-ed89-4c5d-b281-46b3095807d8 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Neutron deleted interface e8551569-369f-4dfc-a57e-c1c06ed135bf; detaching it from the instance and deleting it from the info cache
Oct 26 17:09:03 user nova-compute[75113]: DEBUG nova.network.neutron [req-41e24efd-2f56-4039-876c-ac63f5b66497 req-5df34dc0-ed89-4c5d-b281-46b3095807d8 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:09:03 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Took 0.98 seconds to deallocate network for instance.
Oct 26 17:09:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-41e24efd-2f56-4039-876c-ac63f5b66497 req-5df34dc0-ed89-4c5d-b281-46b3095807d8 service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Detach interface failed, port_id=e8551569-369f-4dfc-a57e-c1c06ed135bf, reason: Instance b07d5f6f-8994-46a8-8c80-c0b803c894b0 could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:09:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:03 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:09:03 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:09:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:03 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Deleted allocations for instance b07d5f6f-8994-46a8-8c80-c0b803c894b0
Oct 26 17:09:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-c183fd25-63a2-405a-8a27-f984c80af8e8 req-5feee774-1ad6-42c4-a35e-47c72de7baaf service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received event network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:09:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c183fd25-63a2-405a-8a27-f984c80af8e8 req-5feee774-1ad6-42c4-a35e-47c72de7baaf service nova] Acquiring lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c183fd25-63a2-405a-8a27-f984c80af8e8 req-5feee774-1ad6-42c4-a35e-47c72de7baaf service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c183fd25-63a2-405a-8a27-f984c80af8e8 req-5feee774-1ad6-42c4-a35e-47c72de7baaf service nova] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-c183fd25-63a2-405a-8a27-f984c80af8e8 req-5feee774-1ad6-42c4-a35e-47c72de7baaf service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] No waiting events found dispatching network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:09:03 user nova-compute[75113]: WARNING nova.compute.manager [req-c183fd25-63a2-405a-8a27-f984c80af8e8 req-5feee774-1ad6-42c4-a35e-47c72de7baaf service nova] [instance: b07d5f6f-8994-46a8-8c80-c0b803c894b0] Received unexpected event network-vif-plugged-e8551569-369f-4dfc-a57e-c1c06ed135bf for instance with vm_state deleted and task_state None.
Oct 26 17:09:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c4845bee-9a42-4a3a-b68d-4a6ee660949b tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "b07d5f6f-8994-46a8-8c80-c0b803c894b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.495s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:09:06 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:09:06 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:09:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:09:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:09:06 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:09:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:06 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Updating instance_info_cache with network_info: [{"id": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "address": "fa:16:3e:cc:a6:4d", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc0af1-e4", "ovs_interfaceid": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:09:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:09:06 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:09:07 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:09:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:08 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:09:08 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:09:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:08 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:09:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:09:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:11 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:09:12 user nova-compute[75113]: INFO nova.compute.claims [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Claim successful on node user
Oct 26 17:09:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:09:12 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:09:12 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:09:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7715MB free_disk=25.060562133789062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.789s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.082s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:09:12 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:09:12 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:09:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.policy [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b04592754c6c406e9d550e9036fe9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfe1e4023f641d6b492c7a0d0fc033b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b5a937c5-26b1-42a2-ad61-660e66688cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 7cbb27a2-37c5-4045-a005-719f79f30714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance f60b73c6-56d5-4d90-828e-d65ced84bbda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e216e427-7231-4491-85f8-607c930e0d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:09:13 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Creating image(s)
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "/opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "/opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "/opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk 1073741824" returned: 0 in 0.047s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Successfully created port: ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Cannot resize image /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Ensure instance console log exists: /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Successfully updated port: ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquired lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-c249b39e-2f55-4685-87d3-b165a8e3a0f3 req-dda532f4-0c71-4df8-a4e0-4f67c164ee6d service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-changed-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-c249b39e-2f55-4685-87d3-b165a8e3a0f3 req-dda532f4-0c71-4df8-a4e0-4f67c164ee6d service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Refreshing instance network info cache due to event network-changed-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c249b39e-2f55-4685-87d3-b165a8e3a0f3 req-dda532f4-0c71-4df8-a4e0-4f67c164ee6d service nova] Acquiring lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Updating instance_info_cache with network_info: [{"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Releasing lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Instance network_info: |[{"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c249b39e-2f55-4685-87d3-b165a8e3a0f3 req-dda532f4-0c71-4df8-a4e0-4f67c164ee6d service nova] Acquired lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.network.neutron [req-c249b39e-2f55-4685-87d3-b165a8e3a0f3 req-dda532f4-0c71-4df8-a4e0-4f67c164ee6d service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Refreshing network info cache for port ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Start _get_guest_xml network_info=[{"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:09:14 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:09:14 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1800361624',display_name='tempest-AttachVolumeTestJSON-server-1800361624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1800361624',id=30,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM0mtS1dljg4Qu1gGqqTeuT9mq/sIHwVu/5XUkXKrM/OqcCuxLS9BGabMHGaDAN2pPR3pksc+bfFVi23MZQGdlYQu9QfNjCvEVQbShJMteVLFo3IenVFiQim0F4GoqwcQ==',key_name='tempest-keypair-618389938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecfe1e4023f641d6b492c7a0d0fc033b',ramdisk_id='',reservation_id='r-hj3gqi9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1430222675',owner_user_name='tempest-AttachVolumeTestJSON-1430222675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b04592754c6c406e9d550e9036fe9ea7',uuid=e216e427-7231-4491-85f8-607c930e0d43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converting VIF {"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.objects.instance [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'pci_devices' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:09:14 user nova-compute[75113]:   <uuid>e216e427-7231-4491-85f8-607c930e0d43</uuid>
Oct 26 17:09:14 user nova-compute[75113]:   <name>instance-0000001e</name>
Oct 26 17:09:14 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:09:14 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:09:14 user nova-compute[75113]:   <metadata>
Oct 26 17:09:14 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:09:14 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:09:14 user nova-compute[75113]:       <nova:name>tempest-AttachVolumeTestJSON-server-1800361624</nova:name>
Oct 26 17:09:14 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:09:14</nova:creationTime>
Oct 26 17:09:14 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:09:14 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:09:14 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:09:14 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:09:14 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:09:14 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:09:14 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:09:14 user nova-compute[75113]:       <nova:owner>
Oct 26 17:09:14 user nova-compute[75113]:         <nova:user uuid="b04592754c6c406e9d550e9036fe9ea7">tempest-AttachVolumeTestJSON-1430222675-project-member</nova:user>
Oct 26 17:09:14 user nova-compute[75113]:         <nova:project uuid="ecfe1e4023f641d6b492c7a0d0fc033b">tempest-AttachVolumeTestJSON-1430222675</nova:project>
Oct 26 17:09:14 user nova-compute[75113]:       </nova:owner>
Oct 26 17:09:14 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:09:14 user nova-compute[75113]:       <nova:ports>
Oct 26 17:09:14 user nova-compute[75113]:         <nova:port uuid="ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8">
Oct 26 17:09:14 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 17:09:14 user nova-compute[75113]:         </nova:port>
Oct 26 17:09:14 user nova-compute[75113]:       </nova:ports>
Oct 26 17:09:14 user nova-compute[75113]:     </nova:instance>
Oct 26 17:09:14 user nova-compute[75113]:   </metadata>
Oct 26 17:09:14 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:09:14 user nova-compute[75113]:     <system>
Oct 26 17:09:14 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:09:14 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:09:14 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:09:14 user nova-compute[75113]:       <entry name="serial">e216e427-7231-4491-85f8-607c930e0d43</entry>
Oct 26 17:09:14 user nova-compute[75113]:       <entry name="uuid">e216e427-7231-4491-85f8-607c930e0d43</entry>
Oct 26 17:09:14 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:09:14 user nova-compute[75113]:     </system>
Oct 26 17:09:14 user nova-compute[75113]:   </sysinfo>
Oct 26 17:09:14 user nova-compute[75113]:   <os>
Oct 26 17:09:14 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:09:14 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:09:14 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:09:14 user nova-compute[75113]:   </os>
Oct 26 17:09:14 user nova-compute[75113]:   <features>
Oct 26 17:09:14 user nova-compute[75113]:     <acpi/>
Oct 26 17:09:14 user nova-compute[75113]:     <apic/>
Oct 26 17:09:14 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:09:14 user nova-compute[75113]:   </features>
Oct 26 17:09:14 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:09:14 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:09:14 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:09:14 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:09:14 user nova-compute[75113]:   </clock>
Oct 26 17:09:14 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:09:14 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:09:14 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:09:14 user nova-compute[75113]:   </cpu>
Oct 26 17:09:14 user nova-compute[75113]:   <devices>
Oct 26 17:09:14 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:09:14 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:09:14 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk"/>
Oct 26 17:09:14 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:09:14 user nova-compute[75113]:     </disk>
Oct 26 17:09:14 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:09:14 user nova-compute[75113]:       <mac address="fa:16:3e:d6:32:fd"/>
Oct 26 17:09:14 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:09:14 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:09:14 user nova-compute[75113]:       <target dev="tapab4b54e0-28"/>
Oct 26 17:09:14 user nova-compute[75113]:     </interface>
Oct 26 17:09:14 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:09:14 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/console.log" append="off"/>
Oct 26 17:09:14 user nova-compute[75113]:     </serial>
Oct 26 17:09:14 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:09:14 user nova-compute[75113]:     <video>
Oct 26 17:09:14 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:09:14 user nova-compute[75113]:     </video>
Oct 26 17:09:14 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:09:14 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:09:14 user nova-compute[75113]:     </rng>
Oct 26 17:09:14 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:09:14 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:09:14 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:09:14 user nova-compute[75113]:     </memballoon>
Oct 26 17:09:14 user nova-compute[75113]:   </devices>
Oct 26 17:09:14 user nova-compute[75113]: </domain>
Oct 26 17:09:14 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1800361624',display_name='tempest-AttachVolumeTestJSON-server-1800361624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1800361624',id=30,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM0mtS1dljg4Qu1gGqqTeuT9mq/sIHwVu/5XUkXKrM/OqcCuxLS9BGabMHGaDAN2pPR3pksc+bfFVi23MZQGdlYQu9QfNjCvEVQbShJMteVLFo3IenVFiQim0F4GoqwcQ==',key_name='tempest-keypair-618389938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecfe1e4023f641d6b492c7a0d0fc033b',ramdisk_id='',reservation_id='r-hj3gqi9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1430222675',owner_user_name='tempest-AttachVolumeTestJSON-1430222675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b04592754c6c406e9d550e9036fe9ea7',uuid=e216e427-7231-4491-85f8-607c930e0d43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converting VIF {"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG os_vif [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '896bf060-4b82-54dd-9a9d-1bfb5c42f794', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab4b54e0-28, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab4b54e0-28, col_values=(('qos', UUID('c081a8a0-9b32-4daf-a243-4159f420a76b')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab4b54e0-28, col_values=(('external_ids', {'iface-id': 'ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:32:fd', 'vm-uuid': 'e216e427-7231-4491-85f8-607c930e0d43'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:14 user nova-compute[75113]: INFO os_vif [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28')
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:09:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No VIF found with MAC fa:16:3e:d6:32:fd, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:09:15 user nova-compute[75113]: DEBUG nova.network.neutron [req-c249b39e-2f55-4685-87d3-b165a8e3a0f3 req-dda532f4-0c71-4df8-a4e0-4f67c164ee6d service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Updated VIF entry in instance network info cache for port ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:09:15 user nova-compute[75113]: DEBUG nova.network.neutron [req-c249b39e-2f55-4685-87d3-b165a8e3a0f3 req-dda532f4-0c71-4df8-a4e0-4f67c164ee6d service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Updating instance_info_cache with network_info: [{"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:09:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c249b39e-2f55-4685-87d3-b165a8e3a0f3 req-dda532f4-0c71-4df8-a4e0-4f67c164ee6d service nova] Releasing lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:09:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-84a01b81-0e6c-4280-a0c3-3a7aef05594d req-d5f9b101-7535-48dc-833a-fd462ba44e68 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:09:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-84a01b81-0e6c-4280-a0c3-3a7aef05594d req-d5f9b101-7535-48dc-833a-fd462ba44e68 service nova] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-84a01b81-0e6c-4280-a0c3-3a7aef05594d req-d5f9b101-7535-48dc-833a-fd462ba44e68 service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-84a01b81-0e6c-4280-a0c3-3a7aef05594d req-d5f9b101-7535-48dc-833a-fd462ba44e68 service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-84a01b81-0e6c-4280-a0c3-3a7aef05594d req-d5f9b101-7535-48dc-833a-fd462ba44e68 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] No waiting events found dispatching network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:09:16 user nova-compute[75113]: WARNING nova.compute.manager [req-84a01b81-0e6c-4280-a0c3-3a7aef05594d req-d5f9b101-7535-48dc-833a-fd462ba44e68 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received unexpected event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 for instance with vm_state building and task_state spawning.
Oct 26 17:09:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:17 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:09:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:09:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:09:18 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: e216e427-7231-4491-85f8-607c930e0d43] Instance spawned successfully.
Oct 26 17:09:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:09:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:09:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:09:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:09:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:09:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:09:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:09:18 user nova-compute[75113]: INFO nova.compute.manager [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Took 5.15 seconds to spawn the instance on the hypervisor.
Oct 26 17:09:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:09:18 user nova-compute[75113]: INFO nova.compute.manager [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Took 6.30 seconds to build instance.
Oct 26 17:09:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3349bac3-7118-40da-bc3e-7d1d4ad78df8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.433s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-bdd40186-9c9b-4a87-ac88-b8a0ad73af09 req-b53b5a99-ecb8-4a8a-b9f5-026857b15407 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:09:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-bdd40186-9c9b-4a87-ac88-b8a0ad73af09 req-b53b5a99-ecb8-4a8a-b9f5-026857b15407 service nova] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-bdd40186-9c9b-4a87-ac88-b8a0ad73af09 req-b53b5a99-ecb8-4a8a-b9f5-026857b15407 service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-bdd40186-9c9b-4a87-ac88-b8a0ad73af09 req-b53b5a99-ecb8-4a8a-b9f5-026857b15407 service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-bdd40186-9c9b-4a87-ac88-b8a0ad73af09 req-b53b5a99-ecb8-4a8a-b9f5-026857b15407 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] No waiting events found dispatching network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:09:18 user nova-compute[75113]: WARNING nova.compute.manager [req-bdd40186-9c9b-4a87-ac88-b8a0ad73af09 req-b53b5a99-ecb8-4a8a-b9f5-026857b15407 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received unexpected event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 for instance with vm_state active and task_state None.
Oct 26 17:09:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:09:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:09:36 user nova-compute[75113]: INFO nova.compute.manager [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] instance snapshotting
Oct 26 17:09:36 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Beginning live snapshot process
Oct 26 17:09:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json -f qcow2 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json -f qcow2 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkwb5896u/b893ef393df849afa0d05b82e8d6e0fe.delta 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkwb5896u/b893ef393df849afa0d05b82e8d6e0fe.delta 1073741824" returned: 0 in 0.048s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 17:09:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 17:09:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 17:09:38 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 17:09:38 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 17:09:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkwb5896u/b893ef393df849afa0d05b82e8d6e0fe.delta /opt/stack/data/nova/instances/snapshots/tmpkwb5896u/b893ef393df849afa0d05b82e8d6e0fe {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:09:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkwb5896u/b893ef393df849afa0d05b82e8d6e0fe.delta /opt/stack/data/nova/instances/snapshots/tmpkwb5896u/b893ef393df849afa0d05b82e8d6e0fe" returned: 0 in 0.376s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:09:38 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Snapshot extracted, beginning image upload
Oct 26 17:09:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:41 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Snapshot image upload complete
Oct 26 17:09:41 user nova-compute[75113]: INFO nova.compute.manager [None req-30d79375-a516-49ef-ac7a-8860f3646041 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Took 5.49 seconds to snapshot the instance on the hypervisor.
Oct 26 17:09:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:44 user nova-compute[75113]: INFO nova.compute.manager [None req-ba420648-8fbb-4e1d-8f3c-1b6a7f0de0ac tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Unrescuing
Oct 26 17:09:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ba420648-8fbb-4e1d-8f3c-1b6a7f0de0ac tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:09:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ba420648-8fbb-4e1d-8f3c-1b6a7f0de0ac tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquired lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:09:44 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ba420648-8fbb-4e1d-8f3c-1b6a7f0de0ac tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:09:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:45 user nova-compute[75113]: DEBUG nova.network.neutron [None req-ba420648-8fbb-4e1d-8f3c-1b6a7f0de0ac tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Updating instance_info_cache with network_info: [{"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:09:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ba420648-8fbb-4e1d-8f3c-1b6a7f0de0ac tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Releasing lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:09:45 user nova-compute[75113]: DEBUG nova.objects.instance [None req-ba420648-8fbb-4e1d-8f3c-1b6a7f0de0ac tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'flavor' on Instance uuid bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:09:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-06112d19-fdbd-44d0-bbb5-6f0c4ae70f4d req-424e4015-4ac8-4f74-a908-3bd91a7c1b86 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-unplugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:09:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-06112d19-fdbd-44d0-bbb5-6f0c4ae70f4d req-424e4015-4ac8-4f74-a908-3bd91a7c1b86 service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-06112d19-fdbd-44d0-bbb5-6f0c4ae70f4d req-424e4015-4ac8-4f74-a908-3bd91a7c1b86 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-06112d19-fdbd-44d0-bbb5-6f0c4ae70f4d req-424e4015-4ac8-4f74-a908-3bd91a7c1b86 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-06112d19-fdbd-44d0-bbb5-6f0c4ae70f4d req-424e4015-4ac8-4f74-a908-3bd91a7c1b86 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-unplugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:09:45 user nova-compute[75113]: WARNING nova.compute.manager [req-06112d19-fdbd-44d0-bbb5-6f0c4ae70f4d req-424e4015-4ac8-4f74-a908-3bd91a7c1b86 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-unplugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:09:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:45 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Instance destroyed successfully.
Oct 26 17:09:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:09:47 user nova-compute[75113]: WARNING nova.compute.manager [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:09:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:09:47 user nova-compute[75113]: WARNING nova.compute.manager [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:09:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:09:47 user nova-compute[75113]: WARNING nova.compute.manager [req-ee65c4ee-8eb6-4a77-a0fd-f7dcf6440274 req-9498d177-7282-4832-99cc-83b51c06f22b service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:09:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-ba420648-8fbb-4e1d-8f3c-1b6a7f0de0ac tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:09:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "f60b73c6-56d5-4d90-828e-d65ced84bbda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:54 user nova-compute[75113]: INFO nova.compute.manager [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Terminating instance
Oct 26 17:09:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-cae53693-72c1-4ebc-a685-b5eb635de078 req-6a7e9692-9e86-4389-a50a-dc3fcb16b3aa service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Received event network-vif-unplugged-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cae53693-72c1-4ebc-a685-b5eb635de078 req-6a7e9692-9e86-4389-a50a-dc3fcb16b3aa service nova] Acquiring lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cae53693-72c1-4ebc-a685-b5eb635de078 req-6a7e9692-9e86-4389-a50a-dc3fcb16b3aa service nova] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cae53693-72c1-4ebc-a685-b5eb635de078 req-6a7e9692-9e86-4389-a50a-dc3fcb16b3aa service nova] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-cae53693-72c1-4ebc-a685-b5eb635de078 req-6a7e9692-9e86-4389-a50a-dc3fcb16b3aa service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] No waiting events found dispatching network-vif-unplugged-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-cae53693-72c1-4ebc-a685-b5eb635de078 req-6a7e9692-9e86-4389-a50a-dc3fcb16b3aa service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Received event network-vif-unplugged-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:09:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:55 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Instance destroyed successfully.
Oct 26 17:09:55 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lazy-loading 'resources' on Instance uuid f60b73c6-56d5-4d90-828e-d65ced84bbda {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-787962727',display_name='tempest-VolumesActionsTest-instance-787962727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-787962727',id=29,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:08:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f47d3d39dd024c499cf74b858d146af8',ramdisk_id='',reservation_id='r-etw100z2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-152632718',owner_user_name='tempest-VolumesActionsTest-152632718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:08:12Z,user_data=None,user_id='3eeb783dc1e94ccfb8780b90eee807cf',uuid=f60b73c6-56d5-4d90-828e-d65ced84bbda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "address": "fa:16:3e:0d:10:47", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabf2c9f-f3", "ovs_interfaceid": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Converting VIF {"id": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "address": "fa:16:3e:0d:10:47", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabf2c9f-f3", "ovs_interfaceid": "babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:10:47,bridge_name='br-int',has_traffic_filtering=True,id=babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabf2c9f-f3') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG os_vif [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:10:47,bridge_name='br-int',has_traffic_filtering=True,id=babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabf2c9f-f3') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbabf2c9f-f3, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8ba96c7-5236-4b8c-af8e-d99d1d271f8b) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:09:55 user nova-compute[75113]: INFO os_vif [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:10:47,bridge_name='br-int',has_traffic_filtering=True,id=babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabf2c9f-f3')
Oct 26 17:09:55 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Deleting instance files /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda_del
Oct 26 17:09:55 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Deletion of /opt/stack/data/nova/instances/f60b73c6-56d5-4d90-828e-d65ced84bbda_del complete
Oct 26 17:09:55 user nova-compute[75113]: INFO nova.compute.manager [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 26 17:09:55 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:09:55 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Took 0.46 seconds to deallocate network for instance.
Oct 26 17:09:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-04d011bf-1269-4965-978b-4c5e8f91a28d req-09176555-18b2-401d-8af5-f954c5ae5f9b service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Received event network-vif-deleted-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:56 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:09:56 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:09:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:56 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Deleted allocations for instance f60b73c6-56d5-4d90-828e-d65ced84bbda
Oct 26 17:09:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a2ecaaab-deda-4b1a-a508-e270439afb81 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.928s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-88a46407-f18a-4431-8417-b7e5fdb01e3d req-ae9997d1-a321-47fd-9262-74720c254b2f service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Received event network-vif-plugged-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:09:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-88a46407-f18a-4431-8417-b7e5fdb01e3d req-ae9997d1-a321-47fd-9262-74720c254b2f service nova] Acquiring lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:09:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-88a46407-f18a-4431-8417-b7e5fdb01e3d req-ae9997d1-a321-47fd-9262-74720c254b2f service nova] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:09:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-88a46407-f18a-4431-8417-b7e5fdb01e3d req-ae9997d1-a321-47fd-9262-74720c254b2f service nova] Lock "f60b73c6-56d5-4d90-828e-d65ced84bbda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:09:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-88a46407-f18a-4431-8417-b7e5fdb01e3d req-ae9997d1-a321-47fd-9262-74720c254b2f service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] No waiting events found dispatching network-vif-plugged-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:09:56 user nova-compute[75113]: WARNING nova.compute.manager [req-88a46407-f18a-4431-8417-b7e5fdb01e3d req-ae9997d1-a321-47fd-9262-74720c254b2f service nova] [instance: f60b73c6-56d5-4d90-828e-d65ced84bbda] Received unexpected event network-vif-plugged-babf2c9f-f39b-4ec4-a1cc-1b31e604f0e1 for instance with vm_state deleted and task_state None.
Oct 26 17:10:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:10:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:10:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:10:06 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:10:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Updating instance_info_cache with network_info: [{"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:10:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:10:12 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:10:12 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:10:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7842MB free_disk=25.008743286132812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b5a937c5-26b1-42a2-ad61-660e66688cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 7cbb27a2-37c5-4045-a005-719f79f30714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e216e427-7231-4491-85f8-607c930e0d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:10:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing inventories for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating ProviderTree inventory for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating inventory in ProviderTree for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing aggregate associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, aggregates: None {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing trait associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.733s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:10:13 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:10:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:17 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:10:17 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 17:10:17 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] There are 0 instances to clean {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 17:10:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-baceee1d-79d6-4dd0-b1e7-993c3ed22f9f req-4b9d2dff-061b-45ab-9058-64a9c647df93 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-changed-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:10:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-baceee1d-79d6-4dd0-b1e7-993c3ed22f9f req-4b9d2dff-061b-45ab-9058-64a9c647df93 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Refreshing instance network info cache due to event network-changed-95e2347e-eaa3-4136-a60c-c31645b50944. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:10:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-baceee1d-79d6-4dd0-b1e7-993c3ed22f9f req-4b9d2dff-061b-45ab-9058-64a9c647df93 service nova] Acquiring lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:10:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-baceee1d-79d6-4dd0-b1e7-993c3ed22f9f req-4b9d2dff-061b-45ab-9058-64a9c647df93 service nova] Acquired lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:10:18 user nova-compute[75113]: DEBUG nova.network.neutron [req-baceee1d-79d6-4dd0-b1e7-993c3ed22f9f req-4b9d2dff-061b-45ab-9058-64a9c647df93 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Refreshing network info cache for port 95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:10:18 user nova-compute[75113]: DEBUG nova.network.neutron [req-baceee1d-79d6-4dd0-b1e7-993c3ed22f9f req-4b9d2dff-061b-45ab-9058-64a9c647df93 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updated VIF entry in instance network info cache for port 95e2347e-eaa3-4136-a60c-c31645b50944. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:10:18 user nova-compute[75113]: DEBUG nova.network.neutron [req-baceee1d-79d6-4dd0-b1e7-993c3ed22f9f req-4b9d2dff-061b-45ab-9058-64a9c647df93 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updating instance_info_cache with network_info: [{"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:10:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-baceee1d-79d6-4dd0-b1e7-993c3ed22f9f req-4b9d2dff-061b-45ab-9058-64a9c647df93 service nova] Releasing lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:10:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-9826c034-c112-42b7-8964-832d9307ae13 req-7de88586-40a3-4f72-b3a8-21a5ed171e9a service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-changed-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:10:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-9826c034-c112-42b7-8964-832d9307ae13 req-7de88586-40a3-4f72-b3a8-21a5ed171e9a service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Refreshing instance network info cache due to event network-changed-95e2347e-eaa3-4136-a60c-c31645b50944. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:10:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9826c034-c112-42b7-8964-832d9307ae13 req-7de88586-40a3-4f72-b3a8-21a5ed171e9a service nova] Acquiring lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:10:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9826c034-c112-42b7-8964-832d9307ae13 req-7de88586-40a3-4f72-b3a8-21a5ed171e9a service nova] Acquired lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:10:19 user nova-compute[75113]: DEBUG nova.network.neutron [req-9826c034-c112-42b7-8964-832d9307ae13 req-7de88586-40a3-4f72-b3a8-21a5ed171e9a service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Refreshing network info cache for port 95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:10:19 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:10:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:10:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:10:19 user nova-compute[75113]: INFO nova.compute.manager [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Detaching volume c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc
Oct 26 17:10:19 user nova-compute[75113]: INFO nova.virt.block_device [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Attempting to driver detach volume c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc from mountpoint /dev/vdb
Oct 26 17:10:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Attempting to detach device vdb from instance b5a937c5-26b1-42a2-ad61-660e66688cf8 from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:10:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:10:19 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:10:19 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:10:19 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:10:19 user nova-compute[75113]:   <serial>c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc</serial>
Oct 26 17:10:19 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:10:19 user nova-compute[75113]: </disk>
Oct 26 17:10:19 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:10:19 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Successfully detached device vdb from instance b5a937c5-26b1-42a2-ad61-660e66688cf8 from the persistent domain config.
Oct 26 17:10:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5a937c5-26b1-42a2-ad61-660e66688cf8 from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:10:19 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:10:19 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:10:19 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:10:19 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:10:19 user nova-compute[75113]:   <serial>c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc</serial>
Oct 26 17:10:19 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:10:19 user nova-compute[75113]: </disk>
Oct 26 17:10:19 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:10:19 user nova-compute[75113]: DEBUG nova.network.neutron [req-9826c034-c112-42b7-8964-832d9307ae13 req-7de88586-40a3-4f72-b3a8-21a5ed171e9a service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updated VIF entry in instance network info cache for port 95e2347e-eaa3-4136-a60c-c31645b50944. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:10:19 user nova-compute[75113]: DEBUG nova.network.neutron [req-9826c034-c112-42b7-8964-832d9307ae13 req-7de88586-40a3-4f72-b3a8-21a5ed171e9a service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updating instance_info_cache with network_info: [{"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:10:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9826c034-c112-42b7-8964-832d9307ae13 req-7de88586-40a3-4f72-b3a8-21a5ed171e9a service nova] Releasing lock "refresh_cache-b5a937c5-26b1-42a2-ad61-660e66688cf8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:10:20 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5a937c5-26b1-42a2-ad61-660e66688cf8 {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:10:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:20 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:10:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:10:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:40 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5a937c5-26b1-42a2-ad61-660e66688cf8 is timed out.
Oct 26 17:10:40 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Successfully detached device vdb from instance b5a937c5-26b1-42a2-ad61-660e66688cf8 from the live domain config.
Oct 26 17:10:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QndPgDGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:10:40 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1a817c-8f52-45f7-9fd3-c35780112b83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:10:40 user nova-compute[75113]: No targets found.
Oct 26 17:10:40 user nova-compute[75113]: iSNS:
Oct 26 17:10:40 user nova-compute[75113]: No targets found.
Oct 26 17:10:40 user nova-compute[75113]: STATIC:
Oct 26 17:10:40 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:10:40 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:10:40 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:10:40 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc
Oct 26 17:10:40 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:10:40 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:10:40 user nova-compute[75113]: FIRMWARE:
Oct 26 17:10:40 user nova-compute[75113]: No targets found.
Oct 26 17:10:40 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:10:40 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:10:40 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a7b238-5efc-4329-b86d-e6f9f8086cbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2330f8-16ea-4221-85c7-f5fc139b50fb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:10:40 user nova-compute[75113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc (non-flash)
Oct 26 17:10:40 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:10:40 user nova-compute[75113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc (non-flash)
Oct 26 17:10:40 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49143e5480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc'): ({'sdc'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Removing single pathed devices sdc {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[287538f1-5a4b-41c6-a961-41770b41f1b6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f989c263-f378-4535-a5db-df8dca31aa93]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Flushing IO for device /dev/sdc {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aed552-3c91-4b33-8afc-51a5007c78fa]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3048dfd-c9a5-44fb-b39f-25ebf033c27e]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0451103-a325-48ac-a183-e6141db6b3c7]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7793dee3-639b-4497-b414-54917b08292d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc, portal: 172.16.0.220,3260]
Oct 26 17:10:40 user nova-compute[75113]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc, portal: 172.16.0.220,3260] successful.
Oct 26 17:10:40 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4cbb7d8-8892-4324-8e9e-a3a1a6322cbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ff3ceb-7257-40a6-9200-3896013f269a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] <== disconnect_volume: return (289ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:10:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:10:41 user nova-compute[75113]: DEBUG nova.objects.instance [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'flavor' on Instance uuid b5a937c5-26b1-42a2-ad61-660e66688cf8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:10:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-dedc6427-b559-43fb-8b08-0c881f738d98 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.730s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:10:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:10:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "60b00b94-8e37-489a-a061-7cd123289b5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:10:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:10:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:10:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:10:44 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:10:44 user nova-compute[75113]: INFO nova.compute.claims [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Claim successful on node user
Oct 26 17:10:44 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:10:44 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:10:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:10:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:10:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:10:44 user nova-compute[75113]: DEBUG nova.network.neutron [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:10:44 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:10:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:10:44 user nova-compute[75113]: DEBUG nova.policy [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c431350f06fd4dbf8d74835f34626ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae5d124cb054dfbbe04433a685903bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:10:44 user nova-compute[75113]: INFO nova.virt.block_device [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Booting with volume-backed-image 91603055-2c31-464d-bb00-ae160ab6e467 at /dev/vda
Oct 26 17:10:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:10:45 user nova-compute[75113]: DEBUG nova.network.neutron [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Successfully created port: 4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Successfully updated port: 4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "refresh_cache-60b00b94-8e37-489a-a061-7cd123289b5d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquired lock "refresh_cache-60b00b94-8e37-489a-a061-7cd123289b5d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "b024b573-3949-4977-a98d-24215bbbe26f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "b024b573-3949-4977-a98d-24215bbbe26f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-d2bfbccd-b3a1-4f3c-b32d-148a65572d7f req-e293a834-e8cb-487b-8f94-39df8e73f553 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-changed-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-d2bfbccd-b3a1-4f3c-b32d-148a65572d7f req-e293a834-e8cb-487b-8f94-39df8e73f553 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Refreshing instance network info cache due to event network-changed-4ff9cdd9-d82f-4214-a51a-73c52e25ab65. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d2bfbccd-b3a1-4f3c-b32d-148a65572d7f req-e293a834-e8cb-487b-8f94-39df8e73f553 service nova] Acquiring lock "refresh_cache-60b00b94-8e37-489a-a061-7cd123289b5d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:10:46 user nova-compute[75113]: INFO nova.compute.claims [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Claim successful on node user
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Updating instance_info_cache with network_info: [{"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Releasing lock "refresh_cache-60b00b94-8e37-489a-a061-7cd123289b5d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Instance network_info: |[{"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d2bfbccd-b3a1-4f3c-b32d-148a65572d7f req-e293a834-e8cb-487b-8f94-39df8e73f553 service nova] Acquired lock "refresh_cache-60b00b94-8e37-489a-a061-7cd123289b5d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.network.neutron [req-d2bfbccd-b3a1-4f3c-b32d-148a65572d7f req-e293a834-e8cb-487b-8f94-39df8e73f553 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Refreshing network info cache for port 4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:10:46 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.policy [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3eeb783dc1e94ccfb8780b90eee807cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47d3d39dd024c499cf74b858d146af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.network.neutron [req-d2bfbccd-b3a1-4f3c-b32d-148a65572d7f req-e293a834-e8cb-487b-8f94-39df8e73f553 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Updated VIF entry in instance network info cache for port 4ff9cdd9-d82f-4214-a51a-73c52e25ab65. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.network.neutron [req-d2bfbccd-b3a1-4f3c-b32d-148a65572d7f req-e293a834-e8cb-487b-8f94-39df8e73f553 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Updating instance_info_cache with network_info: [{"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d2bfbccd-b3a1-4f3c-b32d-148a65572d7f req-e293a834-e8cb-487b-8f94-39df8e73f553 service nova] Releasing lock "refresh_cache-60b00b94-8e37-489a-a061-7cd123289b5d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:10:46 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Creating image(s)
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "/opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "/opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "/opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:10:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.204s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.167s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk 1073741824" returned: 0 in 0.046s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.168s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG nova.network.neutron [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Successfully created port: 98a11018-9290-4578-9f10-f4c3129f684d {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Cannot resize image /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Ensure instance console log exists: /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:10:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Successfully updated port: 98a11018-9290-4578-9f10-f4c3129f684d {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "refresh_cache-b024b573-3949-4977-a98d-24215bbbe26f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquired lock "refresh_cache-b024b573-3949-4977-a98d-24215bbbe26f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-61e330cb-1484-46de-9c1f-399272a56f6e req-64db7e79-565a-4445-98e8-ba4e5ee6e1a9 service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Received event network-changed-98a11018-9290-4578-9f10-f4c3129f684d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-61e330cb-1484-46de-9c1f-399272a56f6e req-64db7e79-565a-4445-98e8-ba4e5ee6e1a9 service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Refreshing instance network info cache due to event network-changed-98a11018-9290-4578-9f10-f4c3129f684d. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-61e330cb-1484-46de-9c1f-399272a56f6e req-64db7e79-565a-4445-98e8-ba4e5ee6e1a9 service nova] Acquiring lock "refresh_cache-b024b573-3949-4977-a98d-24215bbbe26f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Updating instance_info_cache with network_info: [{"id": "98a11018-9290-4578-9f10-f4c3129f684d", "address": "fa:16:3e:cf:5e:9a", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a11018-92", "ovs_interfaceid": "98a11018-9290-4578-9f10-f4c3129f684d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Releasing lock "refresh_cache-b024b573-3949-4977-a98d-24215bbbe26f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Instance network_info: |[{"id": "98a11018-9290-4578-9f10-f4c3129f684d", "address": "fa:16:3e:cf:5e:9a", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a11018-92", "ovs_interfaceid": "98a11018-9290-4578-9f10-f4c3129f684d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-61e330cb-1484-46de-9c1f-399272a56f6e req-64db7e79-565a-4445-98e8-ba4e5ee6e1a9 service nova] Acquired lock "refresh_cache-b024b573-3949-4977-a98d-24215bbbe26f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.network.neutron [req-61e330cb-1484-46de-9c1f-399272a56f6e req-64db7e79-565a-4445-98e8-ba4e5ee6e1a9 service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Refreshing network info cache for port 98a11018-9290-4578-9f10-f4c3129f684d {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Start _get_guest_xml network_info=[{"id": "98a11018-9290-4578-9f10-f4c3129f684d", "address": "fa:16:3e:cf:5e:9a", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a11018-92", "ovs_interfaceid": "98a11018-9290-4578-9f10-f4c3129f684d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:10:48 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:10:48 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-522439897',display_name='tempest-VolumesActionsTest-instance-522439897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-522439897',id=32,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f47d3d39dd024c499cf74b858d146af8',ramdisk_id='',reservation_id='r-gcqdffvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-152632718',owner_user_name='tempest-VolumesActionsTest-152632718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:10:47Z,user_data=None,user_id='3eeb783dc1e94ccfb8780b90eee807cf',uuid=b024b573-3949-4977-a98d-24215bbbe26f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98a11018-9290-4578-9f10-f4c3129f684d", "address": "fa:16:3e:cf:5e:9a", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a11018-92", "ovs_interfaceid": "98a11018-9290-4578-9f10-f4c3129f684d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Converting VIF {"id": "98a11018-9290-4578-9f10-f4c3129f684d", "address": "fa:16:3e:cf:5e:9a", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a11018-92", "ovs_interfaceid": "98a11018-9290-4578-9f10-f4c3129f684d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5e:9a,bridge_name='br-int',has_traffic_filtering=True,id=98a11018-9290-4578-9f10-f4c3129f684d,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a11018-92') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.objects.instance [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lazy-loading 'pci_devices' on Instance uuid b024b573-3949-4977-a98d-24215bbbe26f {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:10:48 user nova-compute[75113]:   <uuid>b024b573-3949-4977-a98d-24215bbbe26f</uuid>
Oct 26 17:10:48 user nova-compute[75113]:   <name>instance-00000020</name>
Oct 26 17:10:48 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:10:48 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:10:48 user nova-compute[75113]:   <metadata>
Oct 26 17:10:48 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:10:48 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:10:48 user nova-compute[75113]:       <nova:name>tempest-VolumesActionsTest-instance-522439897</nova:name>
Oct 26 17:10:48 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:10:48</nova:creationTime>
Oct 26 17:10:48 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:10:48 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:10:48 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:10:48 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:10:48 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:10:48 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:10:48 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:10:48 user nova-compute[75113]:       <nova:owner>
Oct 26 17:10:48 user nova-compute[75113]:         <nova:user uuid="3eeb783dc1e94ccfb8780b90eee807cf">tempest-VolumesActionsTest-152632718-project-member</nova:user>
Oct 26 17:10:48 user nova-compute[75113]:         <nova:project uuid="f47d3d39dd024c499cf74b858d146af8">tempest-VolumesActionsTest-152632718</nova:project>
Oct 26 17:10:48 user nova-compute[75113]:       </nova:owner>
Oct 26 17:10:48 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:10:48 user nova-compute[75113]:       <nova:ports>
Oct 26 17:10:48 user nova-compute[75113]:         <nova:port uuid="98a11018-9290-4578-9f10-f4c3129f684d">
Oct 26 17:10:48 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 17:10:48 user nova-compute[75113]:         </nova:port>
Oct 26 17:10:48 user nova-compute[75113]:       </nova:ports>
Oct 26 17:10:48 user nova-compute[75113]:     </nova:instance>
Oct 26 17:10:48 user nova-compute[75113]:   </metadata>
Oct 26 17:10:48 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:10:48 user nova-compute[75113]:     <system>
Oct 26 17:10:48 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:10:48 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:10:48 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:10:48 user nova-compute[75113]:       <entry name="serial">b024b573-3949-4977-a98d-24215bbbe26f</entry>
Oct 26 17:10:48 user nova-compute[75113]:       <entry name="uuid">b024b573-3949-4977-a98d-24215bbbe26f</entry>
Oct 26 17:10:48 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:10:48 user nova-compute[75113]:     </system>
Oct 26 17:10:48 user nova-compute[75113]:   </sysinfo>
Oct 26 17:10:48 user nova-compute[75113]:   <os>
Oct 26 17:10:48 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:10:48 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:10:48 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:10:48 user nova-compute[75113]:   </os>
Oct 26 17:10:48 user nova-compute[75113]:   <features>
Oct 26 17:10:48 user nova-compute[75113]:     <acpi/>
Oct 26 17:10:48 user nova-compute[75113]:     <apic/>
Oct 26 17:10:48 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:10:48 user nova-compute[75113]:   </features>
Oct 26 17:10:48 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:10:48 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:10:48 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:10:48 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:10:48 user nova-compute[75113]:   </clock>
Oct 26 17:10:48 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:10:48 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:10:48 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:10:48 user nova-compute[75113]:   </cpu>
Oct 26 17:10:48 user nova-compute[75113]:   <devices>
Oct 26 17:10:48 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:10:48 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:10:48 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk"/>
Oct 26 17:10:48 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:10:48 user nova-compute[75113]:     </disk>
Oct 26 17:10:48 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:10:48 user nova-compute[75113]:       <mac address="fa:16:3e:cf:5e:9a"/>
Oct 26 17:10:48 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:10:48 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:10:48 user nova-compute[75113]:       <target dev="tap98a11018-92"/>
Oct 26 17:10:48 user nova-compute[75113]:     </interface>
Oct 26 17:10:48 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:10:48 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/console.log" append="off"/>
Oct 26 17:10:48 user nova-compute[75113]:     </serial>
Oct 26 17:10:48 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:10:48 user nova-compute[75113]:     <video>
Oct 26 17:10:48 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:10:48 user nova-compute[75113]:     </video>
Oct 26 17:10:48 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:10:48 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:10:48 user nova-compute[75113]:     </rng>
Oct 26 17:10:48 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:10:48 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:10:48 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:10:48 user nova-compute[75113]:     </memballoon>
Oct 26 17:10:48 user nova-compute[75113]:   </devices>
Oct 26 17:10:48 user nova-compute[75113]: </domain>
Oct 26 17:10:48 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-522439897',display_name='tempest-VolumesActionsTest-instance-522439897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-522439897',id=32,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f47d3d39dd024c499cf74b858d146af8',ramdisk_id='',reservation_id='r-gcqdffvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-152632718',owner_user_name='tempest-VolumesActionsTest-152632718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:10:47Z,user_data=None,user_id='3eeb783dc1e94ccfb8780b90eee807cf',uuid=b024b573-3949-4977-a98d-24215bbbe26f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98a11018-9290-4578-9f10-f4c3129f684d", "address": "fa:16:3e:cf:5e:9a", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a11018-92", "ovs_interfaceid": "98a11018-9290-4578-9f10-f4c3129f684d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Converting VIF {"id": "98a11018-9290-4578-9f10-f4c3129f684d", "address": "fa:16:3e:cf:5e:9a", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a11018-92", "ovs_interfaceid": "98a11018-9290-4578-9f10-f4c3129f684d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5e:9a,bridge_name='br-int',has_traffic_filtering=True,id=98a11018-9290-4578-9f10-f4c3129f684d,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a11018-92') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG os_vif [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5e:9a,bridge_name='br-int',has_traffic_filtering=True,id=98a11018-9290-4578-9f10-f4c3129f684d,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a11018-92') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bd5e36b-bce4-59e3-9454-39b2734b279d', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98a11018-92, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98a11018-92, col_values=(('qos', UUID('a19ff29e-0d1d-4f4b-8941-4aa871dbb717')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98a11018-92, col_values=(('external_ids', {'iface-id': '98a11018-9290-4578-9f10-f4c3129f684d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:5e:9a', 'vm-uuid': 'b024b573-3949-4977-a98d-24215bbbe26f'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:48 user nova-compute[75113]: INFO os_vif [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5e:9a,bridge_name='br-int',has_traffic_filtering=True,id=98a11018-9290-4578-9f10-f4c3129f684d,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a11018-92')
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] No VIF found with MAC fa:16:3e:cf:5e:9a, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.network.neutron [req-61e330cb-1484-46de-9c1f-399272a56f6e req-64db7e79-565a-4445-98e8-ba4e5ee6e1a9 service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Updated VIF entry in instance network info cache for port 98a11018-9290-4578-9f10-f4c3129f684d. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG nova.network.neutron [req-61e330cb-1484-46de-9c1f-399272a56f6e req-64db7e79-565a-4445-98e8-ba4e5ee6e1a9 service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Updating instance_info_cache with network_info: [{"id": "98a11018-9290-4578-9f10-f4c3129f684d", "address": "fa:16:3e:cf:5e:9a", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a11018-92", "ovs_interfaceid": "98a11018-9290-4578-9f10-f4c3129f684d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:10:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-61e330cb-1484-46de-9c1f-399272a56f6e req-64db7e79-565a-4445-98e8-ba4e5ee6e1a9 service nova] Releasing lock "refresh_cache-b024b573-3949-4977-a98d-24215bbbe26f" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:10:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-6c952a2b-d483-4713-b6bf-c94dbe685d8e req-f5c6239b-689a-41f7-9d64-7e1be3f647de service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Received event network-vif-plugged-98a11018-9290-4578-9f10-f4c3129f684d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:10:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6c952a2b-d483-4713-b6bf-c94dbe685d8e req-f5c6239b-689a-41f7-9d64-7e1be3f647de service nova] Acquiring lock "b024b573-3949-4977-a98d-24215bbbe26f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:10:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6c952a2b-d483-4713-b6bf-c94dbe685d8e req-f5c6239b-689a-41f7-9d64-7e1be3f647de service nova] Lock "b024b573-3949-4977-a98d-24215bbbe26f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:10:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6c952a2b-d483-4713-b6bf-c94dbe685d8e req-f5c6239b-689a-41f7-9d64-7e1be3f647de service nova] Lock "b024b573-3949-4977-a98d-24215bbbe26f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:10:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-6c952a2b-d483-4713-b6bf-c94dbe685d8e req-f5c6239b-689a-41f7-9d64-7e1be3f647de service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] No waiting events found dispatching network-vif-plugged-98a11018-9290-4578-9f10-f4c3129f684d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:10:50 user nova-compute[75113]: WARNING nova.compute.manager [req-6c952a2b-d483-4713-b6bf-c94dbe685d8e req-f5c6239b-689a-41f7-9d64-7e1be3f647de service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Received unexpected event network-vif-plugged-98a11018-9290-4578-9f10-f4c3129f684d for instance with vm_state building and task_state spawning.
Oct 26 17:10:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:10:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:10:52 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Instance spawned successfully.
Oct 26 17:10:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:10:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:10:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:10:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:10:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:10:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:10:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:10:52 user nova-compute[75113]: INFO nova.compute.manager [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Took 5.46 seconds to spawn the instance on the hypervisor.
Oct 26 17:10:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:10:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-7a7996da-18bc-4384-8189-d04035d209c1 req-939c7d63-0fad-4cb0-9475-d5c02e20258c service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Received event network-vif-plugged-98a11018-9290-4578-9f10-f4c3129f684d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:10:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7a7996da-18bc-4384-8189-d04035d209c1 req-939c7d63-0fad-4cb0-9475-d5c02e20258c service nova] Acquiring lock "b024b573-3949-4977-a98d-24215bbbe26f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:10:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7a7996da-18bc-4384-8189-d04035d209c1 req-939c7d63-0fad-4cb0-9475-d5c02e20258c service nova] Lock "b024b573-3949-4977-a98d-24215bbbe26f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:10:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7a7996da-18bc-4384-8189-d04035d209c1 req-939c7d63-0fad-4cb0-9475-d5c02e20258c service nova] Lock "b024b573-3949-4977-a98d-24215bbbe26f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:10:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-7a7996da-18bc-4384-8189-d04035d209c1 req-939c7d63-0fad-4cb0-9475-d5c02e20258c service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] No waiting events found dispatching network-vif-plugged-98a11018-9290-4578-9f10-f4c3129f684d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:10:52 user nova-compute[75113]: WARNING nova.compute.manager [req-7a7996da-18bc-4384-8189-d04035d209c1 req-939c7d63-0fad-4cb0-9475-d5c02e20258c service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Received unexpected event network-vif-plugged-98a11018-9290-4578-9f10-f4c3129f684d for instance with vm_state building and task_state spawning.
Oct 26 17:10:52 user nova-compute[75113]: INFO nova.compute.manager [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Took 6.24 seconds to build instance.
Oct 26 17:10:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-76a14662-6da5-40bd-a2ad-136c5eede00e tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "b024b573-3949-4977-a98d-24215bbbe26f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.355s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:10:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:10:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG os_brick.utils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cdab5e-2524-4f26-af2c-5b977b8b1df0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[16482c39-78d2-49a2-aba8-69e16ac84f6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bec332-e6a9-4594-8273-65a3fcce7acb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3034ee-695b-4692-83dd-90745c2906c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:11:00 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:11:00 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0dbc92-68a6-4dfb-97c1-09bb2f95ff8d]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG os_brick.utils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:11:00 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Updating existing volume attachment record: e671224d-bebb-4a7f-b0e5-73a2eddc0808 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:11:02 user nova-compute[75113]: DEBUG nova.compute.manager [req-09ee0c51-ba51-4d00-a724-69de48db052c req-a772d140-b9c1-40e4-9be8-aa17e0814270 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-changed-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:02 user nova-compute[75113]: DEBUG nova.compute.manager [req-09ee0c51-ba51-4d00-a724-69de48db052c req-a772d140-b9c1-40e4-9be8-aa17e0814270 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Refreshing instance network info cache due to event network-changed-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:11:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-09ee0c51-ba51-4d00-a724-69de48db052c req-a772d140-b9c1-40e4-9be8-aa17e0814270 service nova] Acquiring lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:11:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-09ee0c51-ba51-4d00-a724-69de48db052c req-a772d140-b9c1-40e4-9be8-aa17e0814270 service nova] Acquired lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:11:02 user nova-compute[75113]: DEBUG nova.network.neutron [req-09ee0c51-ba51-4d00-a724-69de48db052c req-a772d140-b9c1-40e4-9be8-aa17e0814270 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Refreshing network info cache for port ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:11:03 user nova-compute[75113]: DEBUG nova.network.neutron [req-09ee0c51-ba51-4d00-a724-69de48db052c req-a772d140-b9c1-40e4-9be8-aa17e0814270 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Updated VIF entry in instance network info cache for port ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:11:03 user nova-compute[75113]: DEBUG nova.network.neutron [req-09ee0c51-ba51-4d00-a724-69de48db052c req-a772d140-b9c1-40e4-9be8-aa17e0814270 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Updating instance_info_cache with network_info: [{"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:11:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-09ee0c51-ba51-4d00-a724-69de48db052c req-a772d140-b9c1-40e4-9be8-aa17e0814270 service nova] Releasing lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:11:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:11:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:11:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:11:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:11:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:11:04 user nova-compute[75113]: WARNING nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Oct 26 17:11:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 04f0351c-6347-4353-bc70-ffa74158496c {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid ff2781bd-106d-4cdb-844c-41c58a191a88 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid b5a937c5-26b1-42a2-ad61-660e66688cf8 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 7cbb27a2-37c5-4045-a005-719f79f30714 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 60b00b94-8e37-489a-a061-7cd123289b5d {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid b024b573-3949-4977-a98d-24215bbbe26f {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "04f0351c-6347-4353-bc70-ffa74158496c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "04f0351c-6347-4353-bc70-ffa74158496c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "ff2781bd-106d-4cdb-844c-41c58a191a88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "7cbb27a2-37c5-4045-a005-719f79f30714" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "7cbb27a2-37c5-4045-a005-719f79f30714" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "e216e427-7231-4491-85f8-607c930e0d43" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "b024b573-3949-4977-a98d-24215bbbe26f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "b024b573-3949-4977-a98d-24215bbbe26f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "04f0351c-6347-4353-bc70-ffa74158496c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "7cbb27a2-37c5-4045-a005-719f79f30714" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "b024b573-3949-4977-a98d-24215bbbe26f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "e216e427-7231-4491-85f8-607c930e0d43" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:11:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:07 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:11:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:09 user nova-compute[75113]: DEBUG nova.objects.instance [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'flavor' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:11:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:10 user nova-compute[75113]: INFO nova.compute.manager [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Attaching volume 90759f59-0815-4d3a-9437-c60888b23158 to /dev/vdb
Oct 26 17:11:10 user nova-compute[75113]: DEBUG os_brick.utils [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdf0e07-82f0-47d6-a195-79212cf97184]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fbe8c0-ef62-4cdb-9c2a-b8afdafc0e64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[680aea25-b252-4d36-81f2-f2febf237286]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb29f572-8bfa-42f7-84dd-cb0d73ba9a31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:11:10 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d334b10-fb94-4cb4-99d9-bc4b94f22781]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG os_brick.utils [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Updating existing volume attachment record: 329ed4ea-0c88-43d5-b09b-c11b1c4b17ee {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Updating instance_info_cache with network_info: [{"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "644032e4-b692-4608-9fd2-f1c609fd766d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "644032e4-b692-4608-9fd2-f1c609fd766d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:11:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:11:11 user nova-compute[75113]: INFO nova.compute.claims [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Claim successful on node user
Oct 26 17:11:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.590s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG nova.compute.manager [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG nova.compute.manager [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG nova.network.neutron [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:11:11 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:11:11 user nova-compute[75113]: DEBUG nova.compute.manager [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG nova.policy [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be611f9c83184dc29d232904a828b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e63bbd8ed7e4fc189d54c828d43e445', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:11:11 user nova-compute[75113]: INFO nova.virt.block_device [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Booting with volume b7cc1431-264b-409a-b2a3-fec3a92d4c72 at /dev/vda
Oct 26 17:11:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG os_brick.utils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:11:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2221edc7-bd84-407b-8905-e86ccc2fceb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[342271a6-6225-4090-959d-22e1aaf581c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2b29f8-afb7-4041-b9c3-bcfd46b058ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3299f373-78a5-455b-9c72-0699f375ec34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:11:12 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cac22fe-a5a0-4e7a-8152-a38e3f59a81e]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG os_brick.utils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Updating existing volume attachment record: 70b540e2-ffbf-4611-81b5-6a917e97cec7 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG nova.network.neutron [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Successfully created port: dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG nova.network.neutron [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Successfully updated port: dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG nova.compute.manager [req-f7c2feea-3d1b-4adc-8f33-52ee800d3dfc req-f82430e2-2bf4-4668-9e8a-ab124959824f service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received event network-changed-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG nova.compute.manager [req-f7c2feea-3d1b-4adc-8f33-52ee800d3dfc req-f82430e2-2bf4-4668-9e8a-ab124959824f service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Refreshing instance network info cache due to event network-changed-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f7c2feea-3d1b-4adc-8f33-52ee800d3dfc req-f82430e2-2bf4-4668-9e8a-ab124959824f service nova] Acquiring lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f7c2feea-3d1b-4adc-8f33-52ee800d3dfc req-f82430e2-2bf4-4668-9e8a-ab124959824f service nova] Acquired lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG nova.network.neutron [req-f7c2feea-3d1b-4adc-8f33-52ee800d3dfc req-f82430e2-2bf4-4668-9e8a-ab124959824f service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Refreshing network info cache for port dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG nova.network.neutron [req-f7c2feea-3d1b-4adc-8f33-52ee800d3dfc req-f82430e2-2bf4-4668-9e8a-ab124959824f service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG nova.network.neutron [req-f7c2feea-3d1b-4adc-8f33-52ee800d3dfc req-f82430e2-2bf4-4668-9e8a-ab124959824f service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f7c2feea-3d1b-4adc-8f33-52ee800d3dfc req-f82430e2-2bf4-4668-9e8a-ab124959824f service nova] Releasing lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquired lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG nova.network.neutron [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG nova.network.neutron [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Updating instance_info_cache with network_info: [{"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:11:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Releasing lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:11:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Instance network_info: |[{"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:11:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:15 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:11:15 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:11:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7776MB free_disk=24.979103088378906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:11:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b5a937c5-26b1-42a2-ad61-660e66688cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 7cbb27a2-37c5-4045-a005-719f79f30714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e216e427-7231-4491-85f8-607c930e0d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 60b00b94-8e37-489a-a061-7cd123289b5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b024b573-3949-4977-a98d-24215bbbe26f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 644032e4-b692-4608-9fd2-f1c609fd766d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:11:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:19 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:11:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:31 user nova-compute[75113]: INFO nova.compute.manager [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Terminating instance
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.compute.manager [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:11:31 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Creating image(s)
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Ensure instance console log exists: /opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Start _get_guest_xml network_info=[{"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e671224d-bebb-4a7f-b0e5-73a2eddc0808', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqoTPlth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60b00b94-8e37-489a-a061-7cd123289b5d', 'attached_at': '', 'detached_at': '', 'volume_id': 'feedeeb4-1371-440a-93f0-d1f973499143', 'serial': 'feedeeb4-1371-440a-93f0-d1f973499143'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:11:31 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:11:31 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqoTPlth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:11:31 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:11:31 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:11:31 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[59827444-69c0-45fa-9a54-383b04bdfb2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:11:31 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf5b141-0ebc-4b5e-98a2-5d24e91191bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143] added
Oct 26 17:11:31 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[081873b6-9abd-4803-834d-7b8888f9d6d5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e954fe05-0e81-49d5-b8f4-7b09dafe0c1d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EqoTPlth {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EqoTPlth" returned: 0 in 0.061s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ada9a17-680c-49d4-9ccb-b39e6198e8cf]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EqoTPlth'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fb2d90-8e3a-4fea-91e3-a18ac838daa5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a58f797-6560-4935-8a68-3ed4f48ae2c6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:11:31 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:11:31 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.compute.manager [req-d108484c-e570-4dbb-b20a-2eeba09e2bf5 req-fcd361c9-f8c2-4d9c-b0e7-e4ced19bf5d5 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-vif-unplugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d108484c-e570-4dbb-b20a-2eeba09e2bf5 req-fcd361c9-f8c2-4d9c-b0e7-e4ced19bf5d5 service nova] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d108484c-e570-4dbb-b20a-2eeba09e2bf5 req-fcd361c9-f8c2-4d9c-b0e7-e4ced19bf5d5 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d108484c-e570-4dbb-b20a-2eeba09e2bf5 req-fcd361c9-f8c2-4d9c-b0e7-e4ced19bf5d5 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.compute.manager [req-d108484c-e570-4dbb-b20a-2eeba09e2bf5 req-fcd361c9-f8c2-4d9c-b0e7-e4ced19bf5d5 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] No waiting events found dispatching network-vif-unplugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.compute.manager [req-d108484c-e570-4dbb-b20a-2eeba09e2bf5 req-fcd361c9-f8c2-4d9c-b0e7-e4ced19bf5d5 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-vif-unplugged-95e2347e-eaa3-4136-a60c-c31645b50944 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fdc32c-a86b-4259-8d75-c9ab63a98717]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143, portal: 172.16.0.220,3260]
Oct 26 17:11:31 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143, portal: 172.16.0.220,3260] successful.
Oct 26 17:11:31 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1dabc3-3c92-4974-9981-3ba119e28886]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e7c4de-c750-4921-82f5-b1884fc06b70]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:11:31 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:11:31 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:11:31 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:11:31 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d09686-0a01-4a61-b473-eb08531fddfd]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqoTPlth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:31 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Instance destroyed successfully.
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.objects.instance [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lazy-loading 'resources' on Instance uuid b5a937c5-26b1-42a2-ad61-660e66688cf8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-940404062',display_name='tempest-TestMinimumBasicScenario-server-940404062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-940404062',id=27,image_ref='98ae3601-3e3c-41b2-8eae-e15758611bbc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs1uR/3mKK4kARjORzAU06qrPd5MWUuYXlnKeBYlOM72uDOOq+2m2u6XN051ku1d07tujNMi5RcoO9SSyPmXeXcPN/yr14TE+1CgGiHQc9orBXrG38V9jd5fmCVOHzUGg==',key_name='tempest-TestMinimumBasicScenario-1008493048',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:06:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd0d356ed9284735abb524c73c143e3b',ramdisk_id='',reservation_id='r-m9b890eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='98ae3601-3e3c-41b2-8eae-e15758611bbc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1757884343',owner_user_name='tempest-TestMinimumBasicScenario-1757884343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:08:34Z,user_data=None,user_id='25d708e692104c63ac2e25531e82d734',uuid=b5a937c5-26b1-42a2-ad61-660e66688cf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converting VIF {"id": "95e2347e-eaa3-4136-a60c-c31645b50944", "address": "fa:16:3e:68:94:9a", "network": {"id": "5f2a4d19-9646-4841-bfcd-43d1f8b2aaea", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1103971682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0d356ed9284735abb524c73c143e3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e2347e-ea", "ovs_interfaceid": "95e2347e-eaa3-4136-a60c-c31645b50944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:94:9a,bridge_name='br-int',has_traffic_filtering=True,id=95e2347e-eaa3-4136-a60c-c31645b50944,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e2347e-ea') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_vif [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:94:9a,bridge_name='br-int',has_traffic_filtering=True,id=95e2347e-eaa3-4136-a60c-c31645b50944,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e2347e-ea') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95e2347e-ea, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec576df3-32e2-4b49-b93f-60225cd4da66) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.compute.manager [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:11:31 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Creating image(s)
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Ensure instance console log exists: /opt/stack/data/nova/instances/644032e4-b692-4608-9fd2-f1c609fd766d/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Start _get_guest_xml network_info=[{"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '70b540e2-ffbf-4611-81b5-6a917e97cec7', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrXfbwWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '644032e4-b692-4608-9fd2-f1c609fd766d', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7cc1431-264b-409a-b2a3-fec3a92d4c72', 'serial': 'b7cc1431-264b-409a-b2a3-fec3a92d4c72'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:11:31 user nova-compute[75113]: INFO os_vif [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:94:9a,bridge_name='br-int',has_traffic_filtering=True,id=95e2347e-eaa3-4136-a60c-c31645b50944,network=Network(5f2a4d19-9646-4841-bfcd-43d1f8b2aaea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e2347e-ea')
Oct 26 17:11:31 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Deleting instance files /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8_del
Oct 26 17:11:31 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Deletion of /opt/stack/data/nova/instances/b5a937c5-26b1-42a2-ad61-660e66688cf8_del complete
Oct 26 17:11:31 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:11:31 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrXfbwWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:11:31 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:11:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:11:31 user nova-compute[75113]: INFO nova.compute.manager [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 26 17:11:31 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:11:31 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26535346437393037', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535346437393037', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.564s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:11:32 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:11:32 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f07add-54b1-466f-bd4f-2cfd4dbf6b17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:11:32 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:10:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-434832296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-434832296',id=31,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-k69bz2e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:10:45Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=60b00b94-8e37-489a-a061-7cd123289b5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:78:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ff9cdd9-d82f-4214-a51a-73c52e25ab65,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff9cdd9-d8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG nova.objects.instance [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'pci_devices' on Instance uuid 60b00b94-8e37-489a-a061-7cd123289b5d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:11:32 user nova-compute[75113]:   <uuid>60b00b94-8e37-489a-a061-7cd123289b5d</uuid>
Oct 26 17:11:32 user nova-compute[75113]:   <name>instance-0000001f</name>
Oct 26 17:11:32 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:11:32 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:11:32 user nova-compute[75113]:   <metadata>
Oct 26 17:11:32 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:11:32 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:11:32 user nova-compute[75113]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-434832296</nova:name>
Oct 26 17:11:32 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:11:31</nova:creationTime>
Oct 26 17:11:32 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:11:32 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:11:32 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:11:32 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:11:32 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:11:32 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:11:32 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:11:32 user nova-compute[75113]:       <nova:owner>
Oct 26 17:11:32 user nova-compute[75113]:         <nova:user uuid="c431350f06fd4dbf8d74835f34626ee7">tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member</nova:user>
Oct 26 17:11:32 user nova-compute[75113]:         <nova:project uuid="9ae5d124cb054dfbbe04433a685903bc">tempest-ServerBootFromVolumeStableRescueTest-2080298495</nova:project>
Oct 26 17:11:32 user nova-compute[75113]:       </nova:owner>
Oct 26 17:11:32 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:11:32 user nova-compute[75113]:       <nova:ports>
Oct 26 17:11:32 user nova-compute[75113]:         <nova:port uuid="4ff9cdd9-d82f-4214-a51a-73c52e25ab65">
Oct 26 17:11:32 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 17:11:32 user nova-compute[75113]:         </nova:port>
Oct 26 17:11:32 user nova-compute[75113]:       </nova:ports>
Oct 26 17:11:32 user nova-compute[75113]:     </nova:instance>
Oct 26 17:11:32 user nova-compute[75113]:   </metadata>
Oct 26 17:11:32 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:11:32 user nova-compute[75113]:     <system>
Oct 26 17:11:32 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:11:32 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:11:32 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:11:32 user nova-compute[75113]:       <entry name="serial">60b00b94-8e37-489a-a061-7cd123289b5d</entry>
Oct 26 17:11:32 user nova-compute[75113]:       <entry name="uuid">60b00b94-8e37-489a-a061-7cd123289b5d</entry>
Oct 26 17:11:32 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:11:32 user nova-compute[75113]:     </system>
Oct 26 17:11:32 user nova-compute[75113]:   </sysinfo>
Oct 26 17:11:32 user nova-compute[75113]:   <os>
Oct 26 17:11:32 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:11:32 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:11:32 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:11:32 user nova-compute[75113]:   </os>
Oct 26 17:11:32 user nova-compute[75113]:   <features>
Oct 26 17:11:32 user nova-compute[75113]:     <acpi/>
Oct 26 17:11:32 user nova-compute[75113]:     <apic/>
Oct 26 17:11:32 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:11:32 user nova-compute[75113]:   </features>
Oct 26 17:11:32 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:11:32 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:11:32 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:11:32 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:11:32 user nova-compute[75113]:   </clock>
Oct 26 17:11:32 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:11:32 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:11:32 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:11:32 user nova-compute[75113]:   </cpu>
Oct 26 17:11:32 user nova-compute[75113]:   <devices>
Oct 26 17:11:32 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:11:32 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:11:32 user nova-compute[75113]:       <source dev="/dev/sdb"/>
Oct 26 17:11:32 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:11:32 user nova-compute[75113]:       <serial>feedeeb4-1371-440a-93f0-d1f973499143</serial>
Oct 26 17:11:32 user nova-compute[75113]:     </disk>
Oct 26 17:11:32 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:11:32 user nova-compute[75113]:       <mac address="fa:16:3e:b3:78:d7"/>
Oct 26 17:11:32 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:11:32 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:11:32 user nova-compute[75113]:       <target dev="tap4ff9cdd9-d8"/>
Oct 26 17:11:32 user nova-compute[75113]:     </interface>
Oct 26 17:11:32 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:11:32 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/console.log" append="off"/>
Oct 26 17:11:32 user nova-compute[75113]:     </serial>
Oct 26 17:11:32 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:11:32 user nova-compute[75113]:     <video>
Oct 26 17:11:32 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:11:32 user nova-compute[75113]:     </video>
Oct 26 17:11:32 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:11:32 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:11:32 user nova-compute[75113]:     </rng>
Oct 26 17:11:32 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:11:32 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:11:32 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:11:32 user nova-compute[75113]:     </memballoon>
Oct 26 17:11:32 user nova-compute[75113]:   </devices>
Oct 26 17:11:32 user nova-compute[75113]: </domain>
Oct 26 17:11:32 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:10:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-434832296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-434832296',id=31,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-k69bz2e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:10:45Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=60b00b94-8e37-489a-a061-7cd123289b5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:78:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ff9cdd9-d82f-4214-a51a-73c52e25ab65,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff9cdd9-d8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_vif [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:78:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ff9cdd9-d82f-4214-a51a-73c52e25ab65,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff9cdd9-d8') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b006987-009d-4541-adb3-2e4824007cb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72] added
Oct 26 17:11:32 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5645ecd8-b6ef-58b4-acc4-f494044aa6dc', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ff9cdd9-d8, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ff9cdd9-d8, col_values=(('qos', UUID('468e4048-31b7-42f6-84e8-0c72fdb41ada')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ff9cdd9-d8, col_values=(('external_ids', {'iface-id': '4ff9cdd9-d82f-4214-a51a-73c52e25ab65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:78:d7', 'vm-uuid': '60b00b94-8e37-489a-a061-7cd123289b5d'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0ef13b-37d0-4b8e-81f2-3fc6b6f60e94]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:32 user nova-compute[75113]: INFO os_vif [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:78:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ff9cdd9-d82f-4214-a51a-73c52e25ab65,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff9cdd9-d8')
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30755cf-536a-447a-b5c0-3014afb1b140]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrXfbwWD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrXfbwWD" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[10773ab8-9411-4f74-b654-dd094a352b67]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hrXfbwWD'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:32 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Took 0.68 seconds to deallocate network for instance.
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67e2aa8-b1ab-445c-8e9d-c5e1e1a7c899]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No VIF found with MAC fa:16:3e:b3:78:d7, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG nova.compute.manager [req-5fde4915-f2f0-4b64-8390-c93f31b68480 req-65973bc4-ce68-4e45-a077-c91b9bb629d9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-vif-deleted-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f9aede-672d-4ea7-af69-6ba821c87d1b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:11:32 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:11:32 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:11:32 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:11:32 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa00c33-53a3-461a-b136-ecd32fe10006]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260]
Oct 26 17:11:32 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260] successful.
Oct 26 17:11:32 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba01f226-cf6b-48fc-87ce-a013732a91d4]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2e953d-4988-44ca-ad6d-0e4c5f669945]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:11:32 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:11:32 user nova-compute[75113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:11:32 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:11:32 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:11:32 user nova-compute[75113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:11:32 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27f28f3-221b-4e9f-ac8d-aa930be086a7]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:11:32 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrXfbwWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:33 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Deleted allocations for instance b5a937c5-26b1-42a2-ad61-660e66688cf8
Oct 26 17:11:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-706bae3f-e542-450d-902e-889cbe88f2c5 tempest-TestMinimumBasicScenario-1757884343 tempest-TestMinimumBasicScenario-1757884343-project-member] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.274s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-0ccd28e8-6160-4870-93ab-df2c1378b166 req-1d1de6ef-c3f2-4c2d-a677-39c0a80b2be9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received event network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0ccd28e8-6160-4870-93ab-df2c1378b166 req-1d1de6ef-c3f2-4c2d-a677-39c0a80b2be9 service nova] Acquiring lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0ccd28e8-6160-4870-93ab-df2c1378b166 req-1d1de6ef-c3f2-4c2d-a677-39c0a80b2be9 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0ccd28e8-6160-4870-93ab-df2c1378b166 req-1d1de6ef-c3f2-4c2d-a677-39c0a80b2be9 service nova] Lock "b5a937c5-26b1-42a2-ad61-660e66688cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-0ccd28e8-6160-4870-93ab-df2c1378b166 req-1d1de6ef-c3f2-4c2d-a677-39c0a80b2be9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] No waiting events found dispatching network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:11:33 user nova-compute[75113]: WARNING nova.compute.manager [req-0ccd28e8-6160-4870-93ab-df2c1378b166 req-1d1de6ef-c3f2-4c2d-a677-39c0a80b2be9 service nova] [instance: b5a937c5-26b1-42a2-ad61-660e66688cf8] Received unexpected event network-vif-plugged-95e2347e-eaa3-4136-a60c-c31645b50944 for instance with vm_state deleted and task_state None.
Oct 26 17:11:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] <== connect_volume: return (1920ms) {'type': 'block', 'scsi_wwn': '23932383239373533', 'path': '/dev/sdc'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932383239373533', 'path': '/dev/sdc'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-93320350',display_name='tempest-ServerActionsTestOtherA-server-93320350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-93320350',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJUID7/sgaW7v1qEz5yD7qPGwhwC+8ZuDRQIBbpLrTvyGuQpgvdE4GCh2rNno39iufUQMngc4uPWtbJQKyjANVZtkRT2aaUI7mWC3EKIsR7qjErlpC+wkdFBgM3eTSeRw==',key_name='tempest-keypair-536776118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-yzll3wm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:11:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=644032e4-b692-4608-9fd2-f1c609fd766d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG nova.objects.instance [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lazy-loading 'pci_devices' on Instance uuid 644032e4-b692-4608-9fd2-f1c609fd766d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:11:33 user nova-compute[75113]:   <uuid>644032e4-b692-4608-9fd2-f1c609fd766d</uuid>
Oct 26 17:11:33 user nova-compute[75113]:   <name>instance-00000021</name>
Oct 26 17:11:33 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:11:33 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:11:33 user nova-compute[75113]:   <metadata>
Oct 26 17:11:33 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:11:33 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:11:33 user nova-compute[75113]:       <nova:name>tempest-ServerActionsTestOtherA-server-93320350</nova:name>
Oct 26 17:11:33 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:11:31</nova:creationTime>
Oct 26 17:11:33 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:11:33 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:11:33 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:11:33 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:11:33 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:11:33 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:11:33 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:11:33 user nova-compute[75113]:       <nova:owner>
Oct 26 17:11:33 user nova-compute[75113]:         <nova:user uuid="be611f9c83184dc29d232904a828b12a">tempest-ServerActionsTestOtherA-2074512325-project-member</nova:user>
Oct 26 17:11:33 user nova-compute[75113]:         <nova:project uuid="5e63bbd8ed7e4fc189d54c828d43e445">tempest-ServerActionsTestOtherA-2074512325</nova:project>
Oct 26 17:11:33 user nova-compute[75113]:       </nova:owner>
Oct 26 17:11:33 user nova-compute[75113]:       <nova:ports>
Oct 26 17:11:33 user nova-compute[75113]:         <nova:port uuid="dc4cb377-3bfa-4500-bbb9-a86c6fc30a64">
Oct 26 17:11:33 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 17:11:33 user nova-compute[75113]:         </nova:port>
Oct 26 17:11:33 user nova-compute[75113]:       </nova:ports>
Oct 26 17:11:33 user nova-compute[75113]:     </nova:instance>
Oct 26 17:11:33 user nova-compute[75113]:   </metadata>
Oct 26 17:11:33 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:11:33 user nova-compute[75113]:     <system>
Oct 26 17:11:33 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:11:33 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:11:33 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:11:33 user nova-compute[75113]:       <entry name="serial">644032e4-b692-4608-9fd2-f1c609fd766d</entry>
Oct 26 17:11:33 user nova-compute[75113]:       <entry name="uuid">644032e4-b692-4608-9fd2-f1c609fd766d</entry>
Oct 26 17:11:33 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:11:33 user nova-compute[75113]:     </system>
Oct 26 17:11:33 user nova-compute[75113]:   </sysinfo>
Oct 26 17:11:33 user nova-compute[75113]:   <os>
Oct 26 17:11:33 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:11:33 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:11:33 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:11:33 user nova-compute[75113]:   </os>
Oct 26 17:11:33 user nova-compute[75113]:   <features>
Oct 26 17:11:33 user nova-compute[75113]:     <acpi/>
Oct 26 17:11:33 user nova-compute[75113]:     <apic/>
Oct 26 17:11:33 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:11:33 user nova-compute[75113]:   </features>
Oct 26 17:11:33 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:11:33 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:11:33 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:11:33 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:11:33 user nova-compute[75113]:   </clock>
Oct 26 17:11:33 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:11:33 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:11:33 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:11:33 user nova-compute[75113]:   </cpu>
Oct 26 17:11:33 user nova-compute[75113]:   <devices>
Oct 26 17:11:33 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:11:33 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:11:33 user nova-compute[75113]:       <source dev="/dev/sdc"/>
Oct 26 17:11:33 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:11:33 user nova-compute[75113]:       <serial>b7cc1431-264b-409a-b2a3-fec3a92d4c72</serial>
Oct 26 17:11:33 user nova-compute[75113]:     </disk>
Oct 26 17:11:33 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:11:33 user nova-compute[75113]:       <mac address="fa:16:3e:3b:b4:50"/>
Oct 26 17:11:33 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:11:33 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:11:33 user nova-compute[75113]:       <target dev="tapdc4cb377-3b"/>
Oct 26 17:11:33 user nova-compute[75113]:     </interface>
Oct 26 17:11:33 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:11:33 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/644032e4-b692-4608-9fd2-f1c609fd766d/console.log" append="off"/>
Oct 26 17:11:33 user nova-compute[75113]:     </serial>
Oct 26 17:11:33 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:11:33 user nova-compute[75113]:     <video>
Oct 26 17:11:33 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:11:33 user nova-compute[75113]:     </video>
Oct 26 17:11:33 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:11:33 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:11:33 user nova-compute[75113]:     </rng>
Oct 26 17:11:33 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:11:33 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:11:33 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:11:33 user nova-compute[75113]:     </memballoon>
Oct 26 17:11:33 user nova-compute[75113]:   </devices>
Oct 26 17:11:33 user nova-compute[75113]: </domain>
Oct 26 17:11:33 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-93320350',display_name='tempest-ServerActionsTestOtherA-server-93320350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-93320350',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJUID7/sgaW7v1qEz5yD7qPGwhwC+8ZuDRQIBbpLrTvyGuQpgvdE4GCh2rNno39iufUQMngc4uPWtbJQKyjANVZtkRT2aaUI7mWC3EKIsR7qjErlpC+wkdFBgM3eTSeRw==',key_name='tempest-keypair-536776118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-yzll3wm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:11:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=644032e4-b692-4608-9fd2-f1c609fd766d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG os_vif [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2721ae23-acf4-5d7b-a07d-c805bccf63a7', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc4cb377-3b, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc4cb377-3b, col_values=(('qos', UUID('b712e692-7b05-41b7-8844-ac005c8f9456')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc4cb377-3b, col_values=(('external_ids', {'iface-id': 'dc4cb377-3bfa-4500-bbb9-a86c6fc30a64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:b4:50', 'vm-uuid': '644032e4-b692-4608-9fd2-f1c609fd766d'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:11:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:33 user nova-compute[75113]: INFO os_vif [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b')
Oct 26 17:11:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:11:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No VIF found with MAC fa:16:3e:3b:b4:50, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:11:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-3fd40170-a2b3-4169-85fe-61e17970333e req-77c5d1f5-3b5f-4e17-973c-a4bc1bba7b01 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3fd40170-a2b3-4169-85fe-61e17970333e req-77c5d1f5-3b5f-4e17-973c-a4bc1bba7b01 service nova] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3fd40170-a2b3-4169-85fe-61e17970333e req-77c5d1f5-3b5f-4e17-973c-a4bc1bba7b01 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3fd40170-a2b3-4169-85fe-61e17970333e req-77c5d1f5-3b5f-4e17-973c-a4bc1bba7b01 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-3fd40170-a2b3-4169-85fe-61e17970333e req-77c5d1f5-3b5f-4e17-973c-a4bc1bba7b01 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] No waiting events found dispatching network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:11:34 user nova-compute[75113]: WARNING nova.compute.manager [req-3fd40170-a2b3-4169-85fe-61e17970333e req-77c5d1f5-3b5f-4e17-973c-a4bc1bba7b01 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received unexpected event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 for instance with vm_state building and task_state spawning.
Oct 26 17:11:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-3fd40170-a2b3-4169-85fe-61e17970333e req-77c5d1f5-3b5f-4e17-973c-a4bc1bba7b01 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3fd40170-a2b3-4169-85fe-61e17970333e req-77c5d1f5-3b5f-4e17-973c-a4bc1bba7b01 service nova] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3fd40170-a2b3-4169-85fe-61e17970333e req-77c5d1f5-3b5f-4e17-973c-a4bc1bba7b01 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3fd40170-a2b3-4169-85fe-61e17970333e req-77c5d1f5-3b5f-4e17-973c-a4bc1bba7b01 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-3fd40170-a2b3-4169-85fe-61e17970333e req-77c5d1f5-3b5f-4e17-973c-a4bc1bba7b01 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] No waiting events found dispatching network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:11:34 user nova-compute[75113]: WARNING nova.compute.manager [req-3fd40170-a2b3-4169-85fe-61e17970333e req-77c5d1f5-3b5f-4e17-973c-a4bc1bba7b01 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received unexpected event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 for instance with vm_state building and task_state spawning.
Oct 26 17:11:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-29f38a44-1869-470c-85b4-84dd3a9c6414 req-af127cd2-db95-4789-910d-2ad4e24927ad service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received event network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-29f38a44-1869-470c-85b4-84dd3a9c6414 req-af127cd2-db95-4789-910d-2ad4e24927ad service nova] Acquiring lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-29f38a44-1869-470c-85b4-84dd3a9c6414 req-af127cd2-db95-4789-910d-2ad4e24927ad service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-29f38a44-1869-470c-85b4-84dd3a9c6414 req-af127cd2-db95-4789-910d-2ad4e24927ad service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-29f38a44-1869-470c-85b4-84dd3a9c6414 req-af127cd2-db95-4789-910d-2ad4e24927ad service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] No waiting events found dispatching network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:11:36 user nova-compute[75113]: WARNING nova.compute.manager [req-29f38a44-1869-470c-85b4-84dd3a9c6414 req-af127cd2-db95-4789-910d-2ad4e24927ad service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received unexpected event network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 for instance with vm_state building and task_state spawning.
Oct 26 17:11:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-29f38a44-1869-470c-85b4-84dd3a9c6414 req-af127cd2-db95-4789-910d-2ad4e24927ad service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received event network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-29f38a44-1869-470c-85b4-84dd3a9c6414 req-af127cd2-db95-4789-910d-2ad4e24927ad service nova] Acquiring lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-29f38a44-1869-470c-85b4-84dd3a9c6414 req-af127cd2-db95-4789-910d-2ad4e24927ad service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-29f38a44-1869-470c-85b4-84dd3a9c6414 req-af127cd2-db95-4789-910d-2ad4e24927ad service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-29f38a44-1869-470c-85b4-84dd3a9c6414 req-af127cd2-db95-4789-910d-2ad4e24927ad service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] No waiting events found dispatching network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:11:36 user nova-compute[75113]: WARNING nova.compute.manager [req-29f38a44-1869-470c-85b4-84dd3a9c6414 req-af127cd2-db95-4789-910d-2ad4e24927ad service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received unexpected event network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 for instance with vm_state building and task_state spawning.
Oct 26 17:11:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:11:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Instance spawned successfully.
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:37 user nova-compute[75113]: INFO nova.compute.manager [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Took 6.09 seconds to spawn the instance on the hypervisor.
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:11:37 user nova-compute[75113]: INFO nova.compute.manager [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Took 53.26 seconds to build instance.
Oct 26 17:11:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-e1d089f3-4df0-44bd-bba8-d165329e8e25 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "60b00b94-8e37-489a-a061-7cd123289b5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.386s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "60b00b94-8e37-489a-a061-7cd123289b5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 32.389s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:37 user nova-compute[75113]: INFO nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 26 17:11:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "60b00b94-8e37-489a-a061-7cd123289b5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:11:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Instance spawned successfully.
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:37 user nova-compute[75113]: INFO nova.compute.manager [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Took 6.04 seconds to spawn the instance on the hypervisor.
Oct 26 17:11:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:11:38 user nova-compute[75113]: INFO nova.compute.manager [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Took 26.95 seconds to build instance.
Oct 26 17:11:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-23626023-d7d8-4a60-888d-44d0ccf2874d tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "644032e4-b692-4608-9fd2-f1c609fd766d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.059s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npCXrgbf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:11:40 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:11:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:11:40 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:11:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:11:40 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b31247-1179-4a74-8f3c-b0a9d8627747]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:11:40 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[487376ab-da8f-4f5f-bbd0-300a6a0b051e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158] added
Oct 26 17:11:40 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[501db23e-eb05-4d06-b97c-b7dc9b6cebcd]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e36053d-8761-41fc-b13f-a57131338c64]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npCXrgbf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npCXrgbf" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[007e80fe-9b7b-4195-995a-47fa94aba8a5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'npCXrgbf'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00c26b3-2909-4313-93b5-9a7dfd581521]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dfa11a-9087-4479-8911-12251a60764d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:11:40 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:11:40 user nova-compute[75113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:11:40 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:11:40 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:11:40 user nova-compute[75113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:11:40 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:11:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --login" returned: 0 in 1.066s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cb96f7-6cb5-45ce-afc3-1f13b52b608d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260]
Oct 26 17:11:41 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260] successful.
Oct 26 17:11:41 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2a334c-28d8-48e2-8dd9-90be5a2c8870]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b96a25-117e-40e1-8dfa-2be7971df50b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:11:41 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:11:41 user nova-compute[75113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:11:41 user nova-compute[75113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:11:41 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:11:41 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:11:41 user nova-compute[75113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:11:41 user nova-compute[75113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:11:41 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.302s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[650949ae-6685-4af3-a401-482681ce4ab9]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:11:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npCXrgbf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:11:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.345s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:11:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] <== connect_volume: return (2347ms) {'type': 'block', 'scsi_wwn': '26238653035363134', 'path': '/dev/sde'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:11:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238653035363134', 'path': '/dev/sde'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:11:42 user nova-compute[75113]: DEBUG nova.objects.instance [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'flavor' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:11:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:11:42 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:11:42 user nova-compute[75113]:   <source dev="/dev/sde"/>
Oct 26 17:11:42 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:11:42 user nova-compute[75113]:   <serial>90759f59-0815-4d3a-9437-c60888b23158</serial>
Oct 26 17:11:42 user nova-compute[75113]: </disk>
Oct 26 17:11:42 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:11:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:11:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:11:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No VIF found with MAC fa:16:3e:d6:32:fd, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:11:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-59bfc9bc-eca0-4adf-b3f6-087920347f53 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.976s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7bef6c08-2d7e-4716-aa09-caacc14f2a93 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7bef6c08-2d7e-4716-aa09-caacc14f2a93 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7bef6c08-2d7e-4716-aa09-caacc14f2a93 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7bef6c08-2d7e-4716-aa09-caacc14f2a93 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75113) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.objects.instance [None req-7bef6c08-2d7e-4716-aa09-caacc14f2a93 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'flavor' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:11:44 user nova-compute[75113]: INFO nova.compute.claims [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Claim successful on node user
Oct 26 17:11:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-cdd231af-4e19-4e89-b0a8-ba90e2a68cc8 req-4ed7ce0c-0cfb-4627-a79e-3f7f09b2eb3f service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-unplugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cdd231af-4e19-4e89-b0a8-ba90e2a68cc8 req-4ed7ce0c-0cfb-4627-a79e-3f7f09b2eb3f service nova] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cdd231af-4e19-4e89-b0a8-ba90e2a68cc8 req-4ed7ce0c-0cfb-4627-a79e-3f7f09b2eb3f service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cdd231af-4e19-4e89-b0a8-ba90e2a68cc8 req-4ed7ce0c-0cfb-4627-a79e-3f7f09b2eb3f service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-cdd231af-4e19-4e89-b0a8-ba90e2a68cc8 req-4ed7ce0c-0cfb-4627-a79e-3f7f09b2eb3f service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] No waiting events found dispatching network-vif-unplugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:11:44 user nova-compute[75113]: WARNING nova.compute.manager [req-cdd231af-4e19-4e89-b0a8-ba90e2a68cc8 req-4ed7ce0c-0cfb-4627-a79e-3f7f09b2eb3f service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received unexpected event network-vif-unplugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 for instance with vm_state active and task_state powering-off.
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.network.neutron [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:11:44 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.policy [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5aa8e21aab014ce6ace0109878275b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d11c5d88b2f4a45acee2e9c7d26043a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:11:44 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: e216e427-7231-4491-85f8-607c930e0d43] Instance destroyed successfully.
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7bef6c08-2d7e-4716-aa09-caacc14f2a93 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:11:44 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Creating image(s)
Oct 26 17:11:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "/opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "/opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "/opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7bef6c08-2d7e-4716-aa09-caacc14f2a93 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.961s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.198s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk 1073741824" returned: 0 in 0.057s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG nova.network.neutron [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Successfully created port: 1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.201s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Checking if we can resize image /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Cannot resize image /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Ensure instance console log exists: /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Successfully updated port: 1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquired lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-01ab1961-2275-444e-9749-231062084439 req-a70d209f-a291-430a-8d33-d52087c552ba service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-changed-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-01ab1961-2275-444e-9749-231062084439 req-a70d209f-a291-430a-8d33-d52087c552ba service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Refreshing instance network info cache due to event network-changed-1dc2c484-d507-4733-8b3f-90f89494e166. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-01ab1961-2275-444e-9749-231062084439 req-a70d209f-a291-430a-8d33-d52087c552ba service nova] Acquiring lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-e6b74a93-64f1-40ec-a97f-8d1dd0fc10fb req-812c3136-0e6e-476c-b4ab-48643c9edcac service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e6b74a93-64f1-40ec-a97f-8d1dd0fc10fb req-812c3136-0e6e-476c-b4ab-48643c9edcac service nova] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e6b74a93-64f1-40ec-a97f-8d1dd0fc10fb req-812c3136-0e6e-476c-b4ab-48643c9edcac service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e6b74a93-64f1-40ec-a97f-8d1dd0fc10fb req-812c3136-0e6e-476c-b4ab-48643c9edcac service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-e6b74a93-64f1-40ec-a97f-8d1dd0fc10fb req-812c3136-0e6e-476c-b4ab-48643c9edcac service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] No waiting events found dispatching network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:11:46 user nova-compute[75113]: WARNING nova.compute.manager [req-e6b74a93-64f1-40ec-a97f-8d1dd0fc10fb req-812c3136-0e6e-476c-b4ab-48643c9edcac service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received unexpected event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 for instance with vm_state stopped and task_state None.
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updating instance_info_cache with network_info: [{"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Releasing lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Instance network_info: |[{"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-01ab1961-2275-444e-9749-231062084439 req-a70d209f-a291-430a-8d33-d52087c552ba service nova] Acquired lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.network.neutron [req-01ab1961-2275-444e-9749-231062084439 req-a70d209f-a291-430a-8d33-d52087c552ba service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Refreshing network info cache for port 1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Start _get_guest_xml network_info=[{"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:11:46 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:11:46 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-171939011',display_name='tempest-ServerRescueNegativeTestJSON-server-171939011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-171939011',id=34,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz8QcdD1FR7/sQvuOZPE6yIwPGirxc4CN6QX5R+wZD/RSeomRaSXT5JTGKOpbc8DTjBxJsSxt56JvBM7TyteiBKrqg33rwF5tZW6dy/Rjbi3A18gcFNDKc5E41jE9Rtig==',key_name='tempest-keypair-147762484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d11c5d88b2f4a45acee2e9c7d26043a',ramdisk_id='',reservation_id='r-jyqvj4zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760587308',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760587308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa8e21aab014ce6ace0109878275b8f',uuid=296a09d4-ed82-4876-9fbd-baadff6a7b4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converting VIF {"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:78:27,bridge_name='br-int',has_traffic_filtering=True,id=1dc2c484-d507-4733-8b3f-90f89494e166,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc2c484-d5') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.objects.instance [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'pci_devices' on Instance uuid 296a09d4-ed82-4876-9fbd-baadff6a7b4d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:11:46 user nova-compute[75113]:   <uuid>296a09d4-ed82-4876-9fbd-baadff6a7b4d</uuid>
Oct 26 17:11:46 user nova-compute[75113]:   <name>instance-00000022</name>
Oct 26 17:11:46 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:11:46 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:11:46 user nova-compute[75113]:   <metadata>
Oct 26 17:11:46 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:11:46 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:11:46 user nova-compute[75113]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-171939011</nova:name>
Oct 26 17:11:46 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:11:46</nova:creationTime>
Oct 26 17:11:46 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:11:46 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:11:46 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:11:46 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:11:46 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:11:46 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:11:46 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:11:46 user nova-compute[75113]:       <nova:owner>
Oct 26 17:11:46 user nova-compute[75113]:         <nova:user uuid="5aa8e21aab014ce6ace0109878275b8f">tempest-ServerRescueNegativeTestJSON-1760587308-project-member</nova:user>
Oct 26 17:11:46 user nova-compute[75113]:         <nova:project uuid="2d11c5d88b2f4a45acee2e9c7d26043a">tempest-ServerRescueNegativeTestJSON-1760587308</nova:project>
Oct 26 17:11:46 user nova-compute[75113]:       </nova:owner>
Oct 26 17:11:46 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:11:46 user nova-compute[75113]:       <nova:ports>
Oct 26 17:11:46 user nova-compute[75113]:         <nova:port uuid="1dc2c484-d507-4733-8b3f-90f89494e166">
Oct 26 17:11:46 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 17:11:46 user nova-compute[75113]:         </nova:port>
Oct 26 17:11:46 user nova-compute[75113]:       </nova:ports>
Oct 26 17:11:46 user nova-compute[75113]:     </nova:instance>
Oct 26 17:11:46 user nova-compute[75113]:   </metadata>
Oct 26 17:11:46 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:11:46 user nova-compute[75113]:     <system>
Oct 26 17:11:46 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:11:46 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:11:46 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:11:46 user nova-compute[75113]:       <entry name="serial">296a09d4-ed82-4876-9fbd-baadff6a7b4d</entry>
Oct 26 17:11:46 user nova-compute[75113]:       <entry name="uuid">296a09d4-ed82-4876-9fbd-baadff6a7b4d</entry>
Oct 26 17:11:46 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:11:46 user nova-compute[75113]:     </system>
Oct 26 17:11:46 user nova-compute[75113]:   </sysinfo>
Oct 26 17:11:46 user nova-compute[75113]:   <os>
Oct 26 17:11:46 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:11:46 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:11:46 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:11:46 user nova-compute[75113]:   </os>
Oct 26 17:11:46 user nova-compute[75113]:   <features>
Oct 26 17:11:46 user nova-compute[75113]:     <acpi/>
Oct 26 17:11:46 user nova-compute[75113]:     <apic/>
Oct 26 17:11:46 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:11:46 user nova-compute[75113]:   </features>
Oct 26 17:11:46 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:11:46 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:11:46 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:11:46 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:11:46 user nova-compute[75113]:   </clock>
Oct 26 17:11:46 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:11:46 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:11:46 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:11:46 user nova-compute[75113]:   </cpu>
Oct 26 17:11:46 user nova-compute[75113]:   <devices>
Oct 26 17:11:46 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:11:46 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:11:46 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk"/>
Oct 26 17:11:46 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:11:46 user nova-compute[75113]:     </disk>
Oct 26 17:11:46 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:11:46 user nova-compute[75113]:       <mac address="fa:16:3e:75:78:27"/>
Oct 26 17:11:46 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:11:46 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:11:46 user nova-compute[75113]:       <target dev="tap1dc2c484-d5"/>
Oct 26 17:11:46 user nova-compute[75113]:     </interface>
Oct 26 17:11:46 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:11:46 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/console.log" append="off"/>
Oct 26 17:11:46 user nova-compute[75113]:     </serial>
Oct 26 17:11:46 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:11:46 user nova-compute[75113]:     <video>
Oct 26 17:11:46 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:11:46 user nova-compute[75113]:     </video>
Oct 26 17:11:46 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:11:46 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:11:46 user nova-compute[75113]:     </rng>
Oct 26 17:11:46 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:11:46 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:11:46 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:11:46 user nova-compute[75113]:     </memballoon>
Oct 26 17:11:46 user nova-compute[75113]:   </devices>
Oct 26 17:11:46 user nova-compute[75113]: </domain>
Oct 26 17:11:46 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-171939011',display_name='tempest-ServerRescueNegativeTestJSON-server-171939011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-171939011',id=34,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz8QcdD1FR7/sQvuOZPE6yIwPGirxc4CN6QX5R+wZD/RSeomRaSXT5JTGKOpbc8DTjBxJsSxt56JvBM7TyteiBKrqg33rwF5tZW6dy/Rjbi3A18gcFNDKc5E41jE9Rtig==',key_name='tempest-keypair-147762484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d11c5d88b2f4a45acee2e9c7d26043a',ramdisk_id='',reservation_id='r-jyqvj4zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760587308',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760587308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa8e21aab014ce6ace0109878275b8f',uuid=296a09d4-ed82-4876-9fbd-baadff6a7b4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converting VIF {"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:78:27,bridge_name='br-int',has_traffic_filtering=True,id=1dc2c484-d507-4733-8b3f-90f89494e166,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc2c484-d5') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG os_vif [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:78:27,bridge_name='br-int',has_traffic_filtering=True,id=1dc2c484-d507-4733-8b3f-90f89494e166,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc2c484-d5') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e07d4d5-1f35-53b3-a591-db6c0cadcf71', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dc2c484-d5, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dc2c484-d5, col_values=(('qos', UUID('5c9180a6-dafc-4e41-9df7-b3b2d697a7db')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dc2c484-d5, col_values=(('external_ids', {'iface-id': '1dc2c484-d507-4733-8b3f-90f89494e166', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:78:27', 'vm-uuid': '296a09d4-ed82-4876-9fbd-baadff6a7b4d'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:46 user nova-compute[75113]: INFO os_vif [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:78:27,bridge_name='br-int',has_traffic_filtering=True,id=1dc2c484-d507-4733-8b3f-90f89494e166,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc2c484-d5')
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No VIF found with MAC fa:16:3e:75:78:27, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.network.neutron [req-01ab1961-2275-444e-9749-231062084439 req-a70d209f-a291-430a-8d33-d52087c552ba service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updated VIF entry in instance network info cache for port 1dc2c484-d507-4733-8b3f-90f89494e166. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG nova.network.neutron [req-01ab1961-2275-444e-9749-231062084439 req-a70d209f-a291-430a-8d33-d52087c552ba service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updating instance_info_cache with network_info: [{"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:11:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-01ab1961-2275-444e-9749-231062084439 req-a70d209f-a291-430a-8d33-d52087c552ba service nova] Releasing lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:11:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-591af0f7-759a-4890-bf47-eb56d7f2223e req-d872d64e-6155-4560-9c1e-88cb069f8852 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-591af0f7-759a-4890-bf47-eb56d7f2223e req-d872d64e-6155-4560-9c1e-88cb069f8852 service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-591af0f7-759a-4890-bf47-eb56d7f2223e req-d872d64e-6155-4560-9c1e-88cb069f8852 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-591af0f7-759a-4890-bf47-eb56d7f2223e req-d872d64e-6155-4560-9c1e-88cb069f8852 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-591af0f7-759a-4890-bf47-eb56d7f2223e req-d872d64e-6155-4560-9c1e-88cb069f8852 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:11:48 user nova-compute[75113]: WARNING nova.compute.manager [req-591af0f7-759a-4890-bf47-eb56d7f2223e req-d872d64e-6155-4560-9c1e-88cb069f8852 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state building and task_state spawning.
Oct 26 17:11:50 user nova-compute[75113]: DEBUG nova.compute.manager [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:11:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:11:50 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Instance spawned successfully.
Oct 26 17:11:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:11:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:11:50 user nova-compute[75113]: INFO nova.compute.manager [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Took 5.35 seconds to spawn the instance on the hypervisor.
Oct 26 17:11:50 user nova-compute[75113]: DEBUG nova.compute.manager [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:11:50 user nova-compute[75113]: INFO nova.compute.manager [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Took 6.28 seconds to build instance.
Oct 26 17:11:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-44d2d92d-e367-4edb-b335-7da68666f805 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.397s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-945ad7fd-af0c-4ef4-a650-d08c09f8514a req-3a3f77e1-aa29-4dd7-9624-d8491883605d service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:11:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-945ad7fd-af0c-4ef4-a650-d08c09f8514a req-3a3f77e1-aa29-4dd7-9624-d8491883605d service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:11:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-945ad7fd-af0c-4ef4-a650-d08c09f8514a req-3a3f77e1-aa29-4dd7-9624-d8491883605d service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:11:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-945ad7fd-af0c-4ef4-a650-d08c09f8514a req-3a3f77e1-aa29-4dd7-9624-d8491883605d service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:11:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-945ad7fd-af0c-4ef4-a650-d08c09f8514a req-3a3f77e1-aa29-4dd7-9624-d8491883605d service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:11:50 user nova-compute[75113]: WARNING nova.compute.manager [req-945ad7fd-af0c-4ef4-a650-d08c09f8514a req-3a3f77e1-aa29-4dd7-9624-d8491883605d service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state active and task_state None.
Oct 26 17:11:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:11:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:12:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:07 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:12:08 user nova-compute[75113]: INFO nova.compute.manager [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Terminating instance
Oct 26 17:12:08 user nova-compute[75113]: DEBUG nova.compute.manager [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG nova.compute.manager [req-7c8ab3d4-76f2-4dec-9596-6cecb7602114 req-36e32ac1-f49f-46c5-903b-197db3d2401e service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Received event network-vif-unplugged-5ccc0af1-e477-4bc0-914b-7229f64a9c0b {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7c8ab3d4-76f2-4dec-9596-6cecb7602114 req-36e32ac1-f49f-46c5-903b-197db3d2401e service nova] Acquiring lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7c8ab3d4-76f2-4dec-9596-6cecb7602114 req-36e32ac1-f49f-46c5-903b-197db3d2401e service nova] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7c8ab3d4-76f2-4dec-9596-6cecb7602114 req-36e32ac1-f49f-46c5-903b-197db3d2401e service nova] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG nova.compute.manager [req-7c8ab3d4-76f2-4dec-9596-6cecb7602114 req-36e32ac1-f49f-46c5-903b-197db3d2401e service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] No waiting events found dispatching network-vif-unplugged-5ccc0af1-e477-4bc0-914b-7229f64a9c0b {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG nova.compute.manager [req-7c8ab3d4-76f2-4dec-9596-6cecb7602114 req-36e32ac1-f49f-46c5-903b-197db3d2401e service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Received event network-vif-unplugged-5ccc0af1-e477-4bc0-914b-7229f64a9c0b for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:12:08 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Instance destroyed successfully.
Oct 26 17:12:08 user nova-compute[75113]: DEBUG nova.objects.instance [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lazy-loading 'resources' on Instance uuid 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2070001326',display_name='tempest-ServersNegativeTestJSON-server-2070001326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2070001326',id=22,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:03:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='786feb5d295e40868b844a95c26cf661',ramdisk_id='',reservation_id='r-bekudl6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1640105602',owner_user_name='tempest-ServersNegativeTestJSON-1640105602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:03:11Z,user_data=None,user_id='0c81e83d3ea04b2a8dabe3ac53205391',uuid=35eb4735-4d81-4e5b-8f8c-70ea7750dcc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "address": "fa:16:3e:cc:a6:4d", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc0af1-e4", "ovs_interfaceid": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Converting VIF {"id": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "address": "fa:16:3e:cc:a6:4d", "network": {"id": "1f48cc4f-4dbd-4126-afc7-6b50f09e3235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1865372594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786feb5d295e40868b844a95c26cf661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc0af1-e4", "ovs_interfaceid": "5ccc0af1-e477-4bc0-914b-7229f64a9c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=5ccc0af1-e477-4bc0-914b-7229f64a9c0b,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc0af1-e4') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG os_vif [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=5ccc0af1-e477-4bc0-914b-7229f64a9c0b,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc0af1-e4') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ccc0af1-e4, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de6f4451-12cb-4d10-919e-88198b4229eb) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:08 user nova-compute[75113]: INFO os_vif [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=5ccc0af1-e477-4bc0-914b-7229f64a9c0b,network=Network(1f48cc4f-4dbd-4126-afc7-6b50f09e3235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc0af1-e4')
Oct 26 17:12:08 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Deleting instance files /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4_del
Oct 26 17:12:08 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Deletion of /opt/stack/data/nova/instances/35eb4735-4d81-4e5b-8f8c-70ea7750dcc4_del complete
Oct 26 17:12:08 user nova-compute[75113]: INFO nova.compute.manager [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 26 17:12:08 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:12:08 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:12:09 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:12:09 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Took 0.47 seconds to deallocate network for instance.
Oct 26 17:12:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-716e3d98-d2ed-4541-ac1c-2e5cb38aef82 req-7612112e-ad7e-4579-b859-d920fcf4c367 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Received event network-vif-deleted-5ccc0af1-e477-4bc0-914b-7229f64a9c0b {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:12:09 user nova-compute[75113]: INFO nova.compute.manager [req-716e3d98-d2ed-4541-ac1c-2e5cb38aef82 req-7612112e-ad7e-4579-b859-d920fcf4c367 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Neutron deleted interface 5ccc0af1-e477-4bc0-914b-7229f64a9c0b; detaching it from the instance and deleting it from the info cache
Oct 26 17:12:09 user nova-compute[75113]: DEBUG nova.network.neutron [req-716e3d98-d2ed-4541-ac1c-2e5cb38aef82 req-7612112e-ad7e-4579-b859-d920fcf4c367 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:12:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-716e3d98-d2ed-4541-ac1c-2e5cb38aef82 req-7612112e-ad7e-4579-b859-d920fcf4c367 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Detach interface failed, port_id=5ccc0af1-e477-4bc0-914b-7229f64a9c0b, reason: Instance 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4 could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:12:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:12:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:12:09 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:12:09 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:12:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:12:09 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Deleted allocations for instance 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4
Oct 26 17:12:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-833fccf1-7548-469e-b2a0-01bc3939eb4a tempest-ServersNegativeTestJSON-1640105602 tempest-ServersNegativeTestJSON-1640105602-project-member] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.744s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:12:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-19b589f1-56d5-4631-ae69-c73089c4e844 req-8713124f-2cad-4b73-96e3-379900eb73f1 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Received event network-vif-plugged-5ccc0af1-e477-4bc0-914b-7229f64a9c0b {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:12:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-19b589f1-56d5-4631-ae69-c73089c4e844 req-8713124f-2cad-4b73-96e3-379900eb73f1 service nova] Acquiring lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:12:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-19b589f1-56d5-4631-ae69-c73089c4e844 req-8713124f-2cad-4b73-96e3-379900eb73f1 service nova] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:12:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-19b589f1-56d5-4631-ae69-c73089c4e844 req-8713124f-2cad-4b73-96e3-379900eb73f1 service nova] Lock "35eb4735-4d81-4e5b-8f8c-70ea7750dcc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:12:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-19b589f1-56d5-4631-ae69-c73089c4e844 req-8713124f-2cad-4b73-96e3-379900eb73f1 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] No waiting events found dispatching network-vif-plugged-5ccc0af1-e477-4bc0-914b-7229f64a9c0b {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:12:10 user nova-compute[75113]: WARNING nova.compute.manager [req-19b589f1-56d5-4631-ae69-c73089c4e844 req-8713124f-2cad-4b73-96e3-379900eb73f1 service nova] [instance: 35eb4735-4d81-4e5b-8f8c-70ea7750dcc4] Received unexpected event network-vif-plugged-5ccc0af1-e477-4bc0-914b-7229f64a9c0b for instance with vm_state deleted and task_state None.
Oct 26 17:12:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:12:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:12:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:12:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:12:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:12:16 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:12:16 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7615MB free_disk=24.994762420654297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 7cbb27a2-37c5-4045-a005-719f79f30714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e216e427-7231-4491-85f8-607c930e0d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 60b00b94-8e37-489a-a061-7cd123289b5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b024b573-3949-4977-a98d-24215bbbe26f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 644032e4-b692-4608-9fd2-f1c609fd766d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:12:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:17 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:12:17 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:12:17 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:12:17 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:12:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:19 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:12:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:12:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "b024b573-3949-4977-a98d-24215bbbe26f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:12:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "b024b573-3949-4977-a98d-24215bbbe26f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:12:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "b024b573-3949-4977-a98d-24215bbbe26f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:12:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "b024b573-3949-4977-a98d-24215bbbe26f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:12:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "b024b573-3949-4977-a98d-24215bbbe26f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:12:36 user nova-compute[75113]: INFO nova.compute.manager [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Terminating instance
Oct 26 17:12:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:12:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG nova.compute.manager [req-edb13fd5-06a5-4c3f-b354-2737da7e44a2 req-4a7d4870-de27-4399-948a-3d8579a8890d service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Received event network-vif-unplugged-98a11018-9290-4578-9f10-f4c3129f684d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-edb13fd5-06a5-4c3f-b354-2737da7e44a2 req-4a7d4870-de27-4399-948a-3d8579a8890d service nova] Acquiring lock "b024b573-3949-4977-a98d-24215bbbe26f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-edb13fd5-06a5-4c3f-b354-2737da7e44a2 req-4a7d4870-de27-4399-948a-3d8579a8890d service nova] Lock "b024b573-3949-4977-a98d-24215bbbe26f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-edb13fd5-06a5-4c3f-b354-2737da7e44a2 req-4a7d4870-de27-4399-948a-3d8579a8890d service nova] Lock "b024b573-3949-4977-a98d-24215bbbe26f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG nova.compute.manager [req-edb13fd5-06a5-4c3f-b354-2737da7e44a2 req-4a7d4870-de27-4399-948a-3d8579a8890d service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] No waiting events found dispatching network-vif-unplugged-98a11018-9290-4578-9f10-f4c3129f684d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG nova.compute.manager [req-edb13fd5-06a5-4c3f-b354-2737da7e44a2 req-4a7d4870-de27-4399-948a-3d8579a8890d service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Received event network-vif-unplugged-98a11018-9290-4578-9f10-f4c3129f684d for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:12:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Instance destroyed successfully.
Oct 26 17:12:37 user nova-compute[75113]: DEBUG nova.objects.instance [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lazy-loading 'resources' on Instance uuid b024b573-3949-4977-a98d-24215bbbe26f {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-522439897',display_name='tempest-VolumesActionsTest-instance-522439897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-522439897',id=32,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:10:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f47d3d39dd024c499cf74b858d146af8',ramdisk_id='',reservation_id='r-gcqdffvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-152632718',owner_user_name='tempest-VolumesActionsTest-152632718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:10:52Z,user_data=None,user_id='3eeb783dc1e94ccfb8780b90eee807cf',uuid=b024b573-3949-4977-a98d-24215bbbe26f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98a11018-9290-4578-9f10-f4c3129f684d", "address": "fa:16:3e:cf:5e:9a", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a11018-92", "ovs_interfaceid": "98a11018-9290-4578-9f10-f4c3129f684d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Converting VIF {"id": "98a11018-9290-4578-9f10-f4c3129f684d", "address": "fa:16:3e:cf:5e:9a", "network": {"id": "6417d65c-088e-42df-ad61-18d00ebacb53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1764761413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f47d3d39dd024c499cf74b858d146af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a11018-92", "ovs_interfaceid": "98a11018-9290-4578-9f10-f4c3129f684d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5e:9a,bridge_name='br-int',has_traffic_filtering=True,id=98a11018-9290-4578-9f10-f4c3129f684d,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a11018-92') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG os_vif [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5e:9a,bridge_name='br-int',has_traffic_filtering=True,id=98a11018-9290-4578-9f10-f4c3129f684d,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a11018-92') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98a11018-92, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a19ff29e-0d1d-4f4b-8941-4aa871dbb717) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:37 user nova-compute[75113]: INFO os_vif [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5e:9a,bridge_name='br-int',has_traffic_filtering=True,id=98a11018-9290-4578-9f10-f4c3129f684d,network=Network(6417d65c-088e-42df-ad61-18d00ebacb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a11018-92')
Oct 26 17:12:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Deleting instance files /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f_del
Oct 26 17:12:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Deletion of /opt/stack/data/nova/instances/b024b573-3949-4977-a98d-24215bbbe26f_del complete
Oct 26 17:12:37 user nova-compute[75113]: INFO nova.compute.manager [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Took 0.77 seconds to destroy the instance on the hypervisor.
Oct 26 17:12:37 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: b024b573-3949-4977-a98d-24215bbbe26f] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:12:37 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:12:37 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Took 0.40 seconds to deallocate network for instance.
Oct 26 17:12:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:12:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:12:38 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:12:38 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:12:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:12:38 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Deleted allocations for instance b024b573-3949-4977-a98d-24215bbbe26f
Oct 26 17:12:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-81c7bbdc-6a41-448a-9086-d54015b5cef4 tempest-VolumesActionsTest-152632718 tempest-VolumesActionsTest-152632718-project-member] Lock "b024b573-3949-4977-a98d-24215bbbe26f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.729s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:12:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-fcfee235-3b28-48cc-a6c1-23b5a37707a8 req-421ca45f-7f0d-4a20-8266-c0026d0e7294 service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Received event network-vif-plugged-98a11018-9290-4578-9f10-f4c3129f684d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:12:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fcfee235-3b28-48cc-a6c1-23b5a37707a8 req-421ca45f-7f0d-4a20-8266-c0026d0e7294 service nova] Acquiring lock "b024b573-3949-4977-a98d-24215bbbe26f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:12:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fcfee235-3b28-48cc-a6c1-23b5a37707a8 req-421ca45f-7f0d-4a20-8266-c0026d0e7294 service nova] Lock "b024b573-3949-4977-a98d-24215bbbe26f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:12:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fcfee235-3b28-48cc-a6c1-23b5a37707a8 req-421ca45f-7f0d-4a20-8266-c0026d0e7294 service nova] Lock "b024b573-3949-4977-a98d-24215bbbe26f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:12:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-fcfee235-3b28-48cc-a6c1-23b5a37707a8 req-421ca45f-7f0d-4a20-8266-c0026d0e7294 service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] No waiting events found dispatching network-vif-plugged-98a11018-9290-4578-9f10-f4c3129f684d {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:12:39 user nova-compute[75113]: WARNING nova.compute.manager [req-fcfee235-3b28-48cc-a6c1-23b5a37707a8 req-421ca45f-7f0d-4a20-8266-c0026d0e7294 service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Received unexpected event network-vif-plugged-98a11018-9290-4578-9f10-f4c3129f684d for instance with vm_state deleted and task_state None.
Oct 26 17:12:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-fcfee235-3b28-48cc-a6c1-23b5a37707a8 req-421ca45f-7f0d-4a20-8266-c0026d0e7294 service nova] [instance: b024b573-3949-4977-a98d-24215bbbe26f] Received event network-vif-deleted-98a11018-9290-4578-9f10-f4c3129f684d {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:12:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:12:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:12:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:13:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:02 user nova-compute[75113]: DEBUG nova.compute.manager [req-2cbad76d-e361-45cc-b7bc-2f7e6686b720 req-6bb160af-850d-41d5-9c1a-a9f58fd4998c service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Received event network-changed-a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:13:02 user nova-compute[75113]: DEBUG nova.compute.manager [req-2cbad76d-e361-45cc-b7bc-2f7e6686b720 req-6bb160af-850d-41d5-9c1a-a9f58fd4998c service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Refreshing instance network info cache due to event network-changed-a1aedd8d-1f49-4949-9e8e-d1800971fd0f. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:13:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2cbad76d-e361-45cc-b7bc-2f7e6686b720 req-6bb160af-850d-41d5-9c1a-a9f58fd4998c service nova] Acquiring lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:13:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2cbad76d-e361-45cc-b7bc-2f7e6686b720 req-6bb160af-850d-41d5-9c1a-a9f58fd4998c service nova] Acquired lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:13:02 user nova-compute[75113]: DEBUG nova.network.neutron [req-2cbad76d-e361-45cc-b7bc-2f7e6686b720 req-6bb160af-850d-41d5-9c1a-a9f58fd4998c service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Refreshing network info cache for port a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:13:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:02 user nova-compute[75113]: DEBUG nova.network.neutron [req-2cbad76d-e361-45cc-b7bc-2f7e6686b720 req-6bb160af-850d-41d5-9c1a-a9f58fd4998c service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updated VIF entry in instance network info cache for port a1aedd8d-1f49-4949-9e8e-d1800971fd0f. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:13:02 user nova-compute[75113]: DEBUG nova.network.neutron [req-2cbad76d-e361-45cc-b7bc-2f7e6686b720 req-6bb160af-850d-41d5-9c1a-a9f58fd4998c service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updating instance_info_cache with network_info: [{"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:13:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2cbad76d-e361-45cc-b7bc-2f7e6686b720 req-6bb160af-850d-41d5-9c1a-a9f58fd4998c service nova] Releasing lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:13:03 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Stashing vm_state: active {{(pid=75113) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-e288deea-e252-4241-aafb-9a10bf4942f7 req-9d9514f1-52ad-4e1c-8c4b-67b9adfd8801 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received event network-changed-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-e288deea-e252-4241-aafb-9a10bf4942f7 req-9d9514f1-52ad-4e1c-8c4b-67b9adfd8801 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Refreshing instance network info cache due to event network-changed-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e288deea-e252-4241-aafb-9a10bf4942f7 req-9d9514f1-52ad-4e1c-8c4b-67b9adfd8801 service nova] Acquiring lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e288deea-e252-4241-aafb-9a10bf4942f7 req-9d9514f1-52ad-4e1c-8c4b-67b9adfd8801 service nova] Acquired lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG nova.network.neutron [req-e288deea-e252-4241-aafb-9a10bf4942f7 req-9d9514f1-52ad-4e1c-8c4b-67b9adfd8801 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Refreshing network info cache for port dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:13:04 user nova-compute[75113]: INFO nova.compute.claims [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Claim successful on node user
Oct 26 17:13:04 user nova-compute[75113]: INFO nova.compute.resource_tracker [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Updating resource usage from migration 4231cee6-9b97-4f7e-bb2a-37714b34ea73
Oct 26 17:13:04 user nova-compute[75113]: DEBUG nova.network.neutron [req-e288deea-e252-4241-aafb-9a10bf4942f7 req-9d9514f1-52ad-4e1c-8c4b-67b9adfd8801 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Updated VIF entry in instance network info cache for port dc4cb377-3bfa-4500-bbb9-a86c6fc30a64. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG nova.network.neutron [req-e288deea-e252-4241-aafb-9a10bf4942f7 req-9d9514f1-52ad-4e1c-8c4b-67b9adfd8801 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Updating instance_info_cache with network_info: [{"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e288deea-e252-4241-aafb-9a10bf4942f7 req-9d9514f1-52ad-4e1c-8c4b-67b9adfd8801 service nova] Releasing lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.438s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:04 user nova-compute[75113]: INFO nova.compute.manager [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Migrating
Oct 26 17:13:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquired lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:13:04 user nova-compute[75113]: DEBUG nova.network.neutron [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG nova.network.neutron [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Updating instance_info_cache with network_info: [{"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Releasing lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Starting migrate_disk_and_power_off {{(pid=75113) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG nova.compute.manager [req-32c84cbf-2827-4929-86e9-b2a24c452ff4 req-1239ef43-1780-4593-92c2-965d71b8c732 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received event network-vif-unplugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-32c84cbf-2827-4929-86e9-b2a24c452ff4 req-1239ef43-1780-4593-92c2-965d71b8c732 service nova] Acquiring lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-32c84cbf-2827-4929-86e9-b2a24c452ff4 req-1239ef43-1780-4593-92c2-965d71b8c732 service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-32c84cbf-2827-4929-86e9-b2a24c452ff4 req-1239ef43-1780-4593-92c2-965d71b8c732 service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG nova.compute.manager [req-32c84cbf-2827-4929-86e9-b2a24c452ff4 req-1239ef43-1780-4593-92c2-965d71b8c732 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] No waiting events found dispatching network-vif-unplugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:13:05 user nova-compute[75113]: WARNING nova.compute.manager [req-32c84cbf-2827-4929-86e9-b2a24c452ff4 req-1239ef43-1780-4593-92c2-965d71b8c732 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received unexpected event network-vif-unplugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 for instance with vm_state active and task_state resize_migrating.
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:05 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Instance destroyed successfully.
Oct 26 17:13:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-93320350',display_name='tempest-ServerActionsTestOtherA-server-93320350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-93320350',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJUID7/sgaW7v1qEz5yD7qPGwhwC+8ZuDRQIBbpLrTvyGuQpgvdE4GCh2rNno39iufUQMngc4uPWtbJQKyjANVZtkRT2aaUI7mWC3EKIsR7qjErlpC+wkdFBgM3eTSeRw==',key_name='tempest-keypair-536776118',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-yzll3wm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:13:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=644032e4-b692-4608-9fd2-f1c609fd766d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2046108746-network", "vif_mac": "fa:16:3e:3b:b4:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2046108746-network", "vif_mac": "fa:16:3e:3b:b4:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG os_vif [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc4cb377-3b, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b712e692-7b05-41b7-8844-ac005c8f9456) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:05 user nova-compute[75113]: INFO os_vif [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b')
Oct 26 17:13:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrXfbwWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:13:05 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:13:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33ac7ed-f6a3-4173-a284-738b2ef83d92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:13:05 user nova-compute[75113]: No targets found.
Oct 26 17:13:05 user nova-compute[75113]: iSNS:
Oct 26 17:13:05 user nova-compute[75113]: No targets found.
Oct 26 17:13:05 user nova-compute[75113]: STATIC:
Oct 26 17:13:05 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143
Oct 26 17:13:05 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:13:05 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:13:05 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158
Oct 26 17:13:05 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:13:05 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:13:05 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:13:05 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:13:05 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:13:05 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72
Oct 26 17:13:05 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:13:05 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:13:05 user nova-compute[75113]: FIRMWARE:
Oct 26 17:13:05 user nova-compute[75113]: No targets found.
Oct 26 17:13:05 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:13:05 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:13:05 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:13:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90fb9bc-1f10-467d-907d-e5ff08225904]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eac4f82-dafb-404b-89bc-a76118543ccb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:06 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:06 user nova-compute[75113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:06 user nova-compute[75113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:06 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:06 user nova-compute[75113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:06 user nova-compute[75113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f492c1d0280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72'): ({'sdc'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Removing single pathed devices sdc {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83c22fa-7305-4a30-9dc2-bfaedd51deb4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8c56be-f156-4993-95a7-e8ad96278a39]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flushing IO for device /dev/sdc {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[158bd0c4-7142-4ba4-802a-0bf653e42c4b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[add92974-773d-4017-87e4-b83afc68effc]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baf058f-5ce2-41c3-af1c-9ad8010a988f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce425f8-ebd7-47e0-ba3f-ca34dd3ec23a]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260]
Oct 26 17:13:06 user nova-compute[75113]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260] successful.
Oct 26 17:13:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b3c310-f950-4ff4-b343-fcbeca9e03dc]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] <== disconnect_volume: return (347ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:13:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:13:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-80ba87c7-6dda-4a99-82b3-23ced5ea4b69 req-1b804d0f-2e81-4f94-9f73-83d0e1d363c3 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received event network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:13:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-80ba87c7-6dda-4a99-82b3-23ced5ea4b69 req-1b804d0f-2e81-4f94-9f73-83d0e1d363c3 service nova] Acquiring lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-80ba87c7-6dda-4a99-82b3-23ced5ea4b69 req-1b804d0f-2e81-4f94-9f73-83d0e1d363c3 service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-80ba87c7-6dda-4a99-82b3-23ced5ea4b69 req-1b804d0f-2e81-4f94-9f73-83d0e1d363c3 service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-80ba87c7-6dda-4a99-82b3-23ced5ea4b69 req-1b804d0f-2e81-4f94-9f73-83d0e1d363c3 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] No waiting events found dispatching network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:13:07 user nova-compute[75113]: WARNING nova.compute.manager [req-80ba87c7-6dda-4a99-82b3-23ced5ea4b69 req-1b804d0f-2e81-4f94-9f73-83d0e1d363c3 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received unexpected event network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 for instance with vm_state active and task_state resize_migrating.
Oct 26 17:13:07 user nova-compute[75113]: DEBUG nova.network.neutron [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Port dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 binding to destination host user is already ACTIVE {{(pid=75113) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 17:13:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:13:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquired lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:13:07 user nova-compute[75113]: DEBUG nova.network.neutron [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG nova.network.neutron [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Updating instance_info_cache with network_info: [{"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Releasing lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG os_brick.utils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df16047-428b-43c5-8bfc-9217566189ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c57c08e-47b4-4884-932d-67fe61bda3be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6de8757-09a9-4eb2-a575-daa1d97aae2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[352a6a0f-d591-48de-b0d5-17c9ac622071]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:13:08 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:13:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d75338f-fe6b-470b-9fe1-b4da3fab8d93]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:13:08 user nova-compute[75113]: DEBUG os_brick.utils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:13:09 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:13:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:12 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:13:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:12 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:13:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:13:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:12 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:13:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:13:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:16 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:13:16 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8083MB free_disk=25.05921173095703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Applying migration context for instance 644032e4-b692-4608-9fd2-f1c609fd766d as it has an incoming, in-progress migration 4231cee6-9b97-4f7e-bb2a-37714b34ea73. Migration status is post-migrating {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 17:13:16 user nova-compute[75113]: INFO nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Updating resource usage from migration 4231cee6-9b97-4f7e-bb2a-37714b34ea73
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 7cbb27a2-37c5-4045-a005-719f79f30714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e216e427-7231-4491-85f8-607c930e0d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 60b00b94-8e37-489a-a061-7cd123289b5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Migration 4231cee6-9b97-4f7e-bb2a-37714b34ea73 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 644032e4-b692-4608-9fd2-f1c609fd766d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:13:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:17 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:13:17 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:13:17 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:13:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:13:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:13:17 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:13:17 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 04f0351c-6347-4353-bc70-ffa74158496c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:18 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Updating instance_info_cache with network_info: [{"id": "de147975-aa0e-4028-af5f-a92993f17b8f", "address": "fa:16:3e:47:99:24", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde147975-aa", "ovs_interfaceid": "de147975-aa0e-4028-af5f-a92993f17b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:13:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-04f0351c-6347-4353-bc70-ffa74158496c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:13:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:13:18 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:13:18 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:13:18 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:13:18 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:13:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:13:19 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:13:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:13:25 user nova-compute[75113]: INFO nova.compute.manager [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Rescuing
Oct 26 17:13:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "refresh_cache-60b00b94-8e37-489a-a061-7cd123289b5d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:13:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquired lock "refresh_cache-60b00b94-8e37-489a-a061-7cd123289b5d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:13:25 user nova-compute[75113]: DEBUG nova.network.neutron [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:13:25 user nova-compute[75113]: DEBUG nova.network.neutron [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Updating instance_info_cache with network_info: [{"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:13:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Releasing lock "refresh_cache-60b00b94-8e37-489a-a061-7cd123289b5d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:13:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-2689d8c0-b9bb-412b-9eb2-ae192208e426 req-7e038c0c-9328-4b45-b748-624739f5d5f2 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-unplugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:13:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2689d8c0-b9bb-412b-9eb2-ae192208e426 req-7e038c0c-9328-4b45-b748-624739f5d5f2 service nova] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2689d8c0-b9bb-412b-9eb2-ae192208e426 req-7e038c0c-9328-4b45-b748-624739f5d5f2 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2689d8c0-b9bb-412b-9eb2-ae192208e426 req-7e038c0c-9328-4b45-b748-624739f5d5f2 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:25 user nova-compute[75113]: DEBUG nova.compute.manager [req-2689d8c0-b9bb-412b-9eb2-ae192208e426 req-7e038c0c-9328-4b45-b748-624739f5d5f2 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] No waiting events found dispatching network-vif-unplugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:13:25 user nova-compute[75113]: WARNING nova.compute.manager [req-2689d8c0-b9bb-412b-9eb2-ae192208e426 req-7e038c0c-9328-4b45-b748-624739f5d5f2 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received unexpected event network-vif-unplugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 for instance with vm_state active and task_state rescuing.
Oct 26 17:13:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:26 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Instance destroyed successfully.
Oct 26 17:13:26 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Attempting a stable device rescue
Oct 26 17:13:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75113) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 17:13:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Instance directory exists: not creating {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 17:13:26 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Creating image(s)
Oct 26 17:13:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "/opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "/opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "/opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:26 user nova-compute[75113]: DEBUG nova.objects.instance [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'trusted_certs' on Instance uuid 60b00b94-8e37-489a-a061-7cd123289b5d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "17bbba7ea053068adeb68679f2f26a74921eda19" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "17bbba7ea053068adeb68679f2f26a74921eda19" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17bbba7ea053068adeb68679f2f26a74921eda19.part --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17bbba7ea053068adeb68679f2f26a74921eda19.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:27 user nova-compute[75113]: DEBUG nova.virt.images [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] edc01ac9-17d6-4a2d-a5ad-dcdd763d6d5d was qcow2, converting to raw {{(pid=75113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 17:13:27 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 17:13:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/17bbba7ea053068adeb68679f2f26a74921eda19.part /opt/stack/data/nova/instances/_base/17bbba7ea053068adeb68679f2f26a74921eda19.converted {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-d1ebe66b-03b1-4915-a217-e38d4e0ea5c0 req-bb538c12-8142-473b-b3e4-90705fe6193d service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:13:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1ebe66b-03b1-4915-a217-e38d4e0ea5c0 req-bb538c12-8142-473b-b3e4-90705fe6193d service nova] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1ebe66b-03b1-4915-a217-e38d4e0ea5c0 req-bb538c12-8142-473b-b3e4-90705fe6193d service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1ebe66b-03b1-4915-a217-e38d4e0ea5c0 req-bb538c12-8142-473b-b3e4-90705fe6193d service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-d1ebe66b-03b1-4915-a217-e38d4e0ea5c0 req-bb538c12-8142-473b-b3e4-90705fe6193d service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] No waiting events found dispatching network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:13:27 user nova-compute[75113]: WARNING nova.compute.manager [req-d1ebe66b-03b1-4915-a217-e38d4e0ea5c0 req-bb538c12-8142-473b-b3e4-90705fe6193d service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received unexpected event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 for instance with vm_state active and task_state rescuing.
Oct 26 17:13:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/17bbba7ea053068adeb68679f2f26a74921eda19.part /opt/stack/data/nova/instances/_base/17bbba7ea053068adeb68679f2f26a74921eda19.converted" returned: 0 in 0.363s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17bbba7ea053068adeb68679f2f26a74921eda19.converted --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17bbba7ea053068adeb68679f2f26a74921eda19.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "17bbba7ea053068adeb68679f2f26a74921eda19" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.737s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "17bbba7ea053068adeb68679f2f26a74921eda19" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "17bbba7ea053068adeb68679f2f26a74921eda19" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17bbba7ea053068adeb68679f2f26a74921eda19 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Starting finish_migration {{(pid=75113) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Instance directory exists: not creating {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 17:13:28 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Creating image(s)
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Ensure instance console log exists: /opt/stack/data/nova/instances/644032e4-b692-4608-9fd2-f1c609fd766d/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Start _get_guest_xml network_info=[{"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2046108746-network", "vif_mac": "fa:16:3e:3b:b4:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1e7ec2d5-25b5-4ac0-b844-8e21dc95b01c', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrXfbwWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '644032e4-b692-4608-9fd2-f1c609fd766d', 'attached_at': '2023-10-26T17:13:28.000000', 'detached_at': '', 'volume_id': 'b7cc1431-264b-409a-b2a3-fec3a92d4c72', 'serial': 'b7cc1431-264b-409a-b2a3-fec3a92d4c72'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:13:28 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:13:28 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrXfbwWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:13:28 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:13:28 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:13:28 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5f90d4-3c29-430d-a6b3-82c307ee047b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:13:28 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4166cb-9b04-47aa-8de5-a5d4f07797c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72] added
Oct 26 17:13:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17bbba7ea053068adeb68679f2f26a74921eda19 --force-share --output=json" returned: 0 in 0.180s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/17bbba7ea053068adeb68679f2f26a74921eda19,backing_fmt=raw /opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.rescue {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6760197a-e93d-437b-971c-aede433be4d5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/17bbba7ea053068adeb68679f2f26a74921eda19,backing_fmt=raw /opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.rescue" returned: 0 in 0.051s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "17bbba7ea053068adeb68679f2f26a74921eda19" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.objects.instance [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'migration_context' on Instance uuid 60b00b94-8e37-489a-a061-7cd123289b5d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3518953e-3820-4682-b746-8b3be62ccf69]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrXfbwWD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.objects.base [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Object Instance<60b00b94-8e37-489a-a061-7cd123289b5d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Start _get_guest_xml network_info=[{"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "vif_mac": "fa:16:3e:b3:78:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'edc01ac9-17d6-4a2d-a5ad-dcdd763d6d5d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e671224d-bebb-4a7f-b0e5-73a2eddc0808', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqoTPlth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '60b00b94-8e37-489a-a061-7cd123289b5d', 'attached_at': '', 'detached_at': '', 'volume_id': 'feedeeb4-1371-440a-93f0-d1f973499143', 'serial': 'feedeeb4-1371-440a-93f0-d1f973499143'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.objects.instance [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'resources' on Instance uuid 60b00b94-8e37-489a-a061-7cd123289b5d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.objects.base [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Object Instance<60b00b94-8e37-489a-a061-7cd123289b5d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.objects.instance [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'numa_topology' on Instance uuid 60b00b94-8e37-489a-a061-7cd123289b5d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrXfbwWD" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[90892fb4-2dab-438d-b75a-b357d0397215]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hrXfbwWD'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.objects.base [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Object Instance<60b00b94-8e37-489a-a061-7cd123289b5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:13:28 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:13:28 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.objects.instance [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'vcpu_model' on Instance uuid 60b00b94-8e37-489a-a061-7cd123289b5d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e2a2a-9387-412b-94b8-056ab215db02]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.objects.base [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Object Instance<60b00b94-8e37-489a-a061-7cd123289b5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqoTPlth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:13:28 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b45d19-5905-415b-8ebb-9ac70e2d1e2d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:28 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:28 user nova-compute[75113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:28 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:28 user nova-compute[75113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1c8f1d-2fd6-4dbd-a68f-1bb336c964cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260]
Oct 26 17:13:28 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260] successful.
Oct 26 17:13:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e9307f-4c4b-437a-9676-e8d40adc38cf]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d22d0aa-7700-4f5e-8cf0-008bdc9fc08f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:28 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:28 user nova-compute[75113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:28 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:28 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:28 user nova-compute[75113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:28 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:28 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8f047e-ffde-4830-937a-1862e73c1282]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:13:28 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrXfbwWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23932383239373533', 'path': '/dev/sdc'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932383239373533', 'path': '/dev/sdc'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.170s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:13:29 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:13:29 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f0f6c8-2f3f-4f76-8df2-91201216d125]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EqoTPlth\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 17:13:29 user nova-compute[75113]: node.name = iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143
Oct 26 17:13:29 user nova-compute[75113]: node.tpgt = -1
Oct 26 17:13:29 user nova-compute[75113]: node.startup = automatic
Oct 26 17:13:29 user nova-compute[75113]: node.leading_login = No
Oct 26 17:13:29 user nova-compute[75113]: iface.iscsi_ifacename = default
Oct 26 17:13:29 user nova-compute[75113]: iface.net_ifacename = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.ipaddress = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.prefix_len = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.hwaddress = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.transport_name = tcp
Oct 26 17:13:29 user nova-compute[75113]: iface.initiatorname = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.state = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.vlan_id = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.vlan_priority = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.vlan_state = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.iface_num = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.mtu = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.port = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.bootproto = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.subnet_mask = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.gateway = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.dhcp_alt_client_id = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.dhcp_dns = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.dhcp_learn_iqn = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.dhcp_vendor_id_state = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.dhcp_vendor_id = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.dhcp_slp_da = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.fragmentation = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.gratuitous_arp = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.incoming_forwarding = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.tos_state = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.tos = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.ttl = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.delayed_ack = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.tcp_nagle = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.tcp_wsf_state = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.tcp_wsf = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.tcp_timer_scale = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.tcp_timestamp = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.redirect = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.def_task_mgmt_timeout = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.header_digest = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.data_digest = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.immediate_data = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.initial_r2t = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.data_seq_inorder = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.data_pdu_inorder = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.erl = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.max_receive_data_len = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.first_burst_len = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.max_outstanding_r2t = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.max_burst_len = 0
Oct 26 17:13:29 user nova-compute[75113]: iface.chap_auth = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.bidi_chap = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.strict_login_compliance = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.discovery_auth = <empty>
Oct 26 17:13:29 user nova-compute[75113]: iface.discovery_logout = <empty>
Oct 26 17:13:29 user nova-compute[75113]: node.discovery_address = <empty>
Oct 26 17:13:29 user nova-compute[75113]: node.discovery_port = 0
Oct 26 17:13:29 user nova-compute[75113]: node.discovery_type = static
Oct 26 17:13:29 user nova-compute[75113]: node.session.initial_cmdsn = 0
Oct 26 17:13:29 user nova-compute[75113]: node.session.initial_login_retry_max = 8
Oct 26 17:13:29 user nova-compute[75113]: node.session.xmit_thread_priority = -20
Oct 26 17:13:29 user nova-compute[75113]: node.session.cmds_max = 128
Oct 26 17:13:29 user nova-compute[75113]: node.session.queue_depth = 32
Oct 26 17:13:29 user nova-compute[75113]: node.session.nr_sessions = 1
Oct 26 17:13:29 user nova-compute[75113]: node.session.auth.authmethod = CHAP
Oct 26 17:13:29 user nova-compute[75113]: node.session.auth.username = EqoTPlth
Oct 26 17:13:29 user nova-compute[75113]: node.session.auth.password = ***
Oct 26 17:13:29 user nova-compute[75113]: node.session.auth.username_in = <empty>
Oct 26 17:13:29 user nova-compute[75113]: node.session.auth.password_in = <empty>
Oct 26 17:13:29 user nova-compute[75113]: node.session.auth.chap_algs = MD5
Oct 26 17:13:29 user nova-compute[75113]: node.session.timeo.replacement_timeout = 120
Oct 26 17:13:29 user nova-compute[75113]: node.session.err_timeo.abort_timeout = 15
Oct 26 17:13:29 user nova-compute[75113]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 17:13:29 user nova-compute[75113]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 17:13:29 user nova-compute[75113]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 17:13:29 user nova-compute[75113]: node.session.iscsi.FastAbort = Yes
Oct 26 17:13:29 user nova-compute[75113]: node.session.iscsi.InitialR2T = No
Oct 26 17:13:29 user nova-compute[75113]: node.session.iscsi.ImmediateData = Yes
Oct 26 17:13:29 user nova-compute[75113]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 17:13:29 user nova-compute[75113]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 17:13:29 user nova-compute[75113]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 17:13:29 user nova-compute[75113]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 17:13:29 user nova-compute[75113]: node.session.iscsi.MaxConnections = 1
Oct 26 17:13:29 user nova-compute[75113]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 17:13:29 user nova-compute[75113]: node.session.iscsi.ERL = 0
Oct 26 17:13:29 user nova-compute[75113]: node.session.scan = manual
Oct 26 17:13:29 user nova-compute[75113]: node.session.reopen_max = 0
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].address = 172.16.0.220
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].port = 3260
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].startup = manual
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].tcp.window_size = 524288
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].tcp.type_of_service = 0
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].timeo.logout_timeout = 15
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].timeo.login_timeout = 15
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].timeo.auth_timeout = 45
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].iscsi.DataDigest = None
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].iscsi.IFMarker = No
Oct 26 17:13:29 user nova-compute[75113]: node.conn[0].iscsi.OFMarker = No
Oct 26 17:13:29 user nova-compute[75113]: # END RECORD
Oct 26 17:13:29 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-93320350',display_name='tempest-ServerActionsTestOtherA-server-93320350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-93320350',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJUID7/sgaW7v1qEz5yD7qPGwhwC+8ZuDRQIBbpLrTvyGuQpgvdE4GCh2rNno39iufUQMngc4uPWtbJQKyjANVZtkRT2aaUI7mWC3EKIsR7qjErlpC+wkdFBgM3eTSeRw==',key_name='tempest-keypair-536776118',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-yzll3wm0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=644032e4-b692-4608-9fd2-f1c609fd766d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2046108746-network", "vif_mac": "fa:16:3e:3b:b4:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2046108746-network", "vif_mac": "fa:16:3e:3b:b4:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:13:29 user nova-compute[75113]:   <uuid>644032e4-b692-4608-9fd2-f1c609fd766d</uuid>
Oct 26 17:13:29 user nova-compute[75113]:   <name>instance-00000021</name>
Oct 26 17:13:29 user nova-compute[75113]:   <memory>2097152</memory>
Oct 26 17:13:29 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:13:29 user nova-compute[75113]:   <metadata>
Oct 26 17:13:29 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:13:29 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:13:29 user nova-compute[75113]:       <nova:name>tempest-ServerActionsTestOtherA-server-93320350</nova:name>
Oct 26 17:13:29 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:13:28</nova:creationTime>
Oct 26 17:13:29 user nova-compute[75113]:       <nova:flavor name="m1.small">
Oct 26 17:13:29 user nova-compute[75113]:         <nova:memory>2048</nova:memory>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:disk>20</nova:disk>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:13:29 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:13:29 user nova-compute[75113]:       <nova:owner>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:user uuid="be611f9c83184dc29d232904a828b12a">tempest-ServerActionsTestOtherA-2074512325-project-member</nova:user>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:project uuid="5e63bbd8ed7e4fc189d54c828d43e445">tempest-ServerActionsTestOtherA-2074512325</nova:project>
Oct 26 17:13:29 user nova-compute[75113]:       </nova:owner>
Oct 26 17:13:29 user nova-compute[75113]:       <nova:ports>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:port uuid="dc4cb377-3bfa-4500-bbb9-a86c6fc30a64">
Oct 26 17:13:29 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 17:13:29 user nova-compute[75113]:         </nova:port>
Oct 26 17:13:29 user nova-compute[75113]:       </nova:ports>
Oct 26 17:13:29 user nova-compute[75113]:     </nova:instance>
Oct 26 17:13:29 user nova-compute[75113]:   </metadata>
Oct 26 17:13:29 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:13:29 user nova-compute[75113]:     <system>
Oct 26 17:13:29 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:13:29 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:13:29 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:13:29 user nova-compute[75113]:       <entry name="serial">644032e4-b692-4608-9fd2-f1c609fd766d</entry>
Oct 26 17:13:29 user nova-compute[75113]:       <entry name="uuid">644032e4-b692-4608-9fd2-f1c609fd766d</entry>
Oct 26 17:13:29 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:13:29 user nova-compute[75113]:     </system>
Oct 26 17:13:29 user nova-compute[75113]:   </sysinfo>
Oct 26 17:13:29 user nova-compute[75113]:   <os>
Oct 26 17:13:29 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:13:29 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:13:29 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:13:29 user nova-compute[75113]:   </os>
Oct 26 17:13:29 user nova-compute[75113]:   <features>
Oct 26 17:13:29 user nova-compute[75113]:     <acpi/>
Oct 26 17:13:29 user nova-compute[75113]:     <apic/>
Oct 26 17:13:29 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:13:29 user nova-compute[75113]:   </features>
Oct 26 17:13:29 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:13:29 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:13:29 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:13:29 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:13:29 user nova-compute[75113]:   </clock>
Oct 26 17:13:29 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:13:29 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:13:29 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:13:29 user nova-compute[75113]:   </cpu>
Oct 26 17:13:29 user nova-compute[75113]:   <devices>
Oct 26 17:13:29 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:13:29 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:13:29 user nova-compute[75113]:       <source dev="/dev/sdc"/>
Oct 26 17:13:29 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:13:29 user nova-compute[75113]:       <serial>b7cc1431-264b-409a-b2a3-fec3a92d4c72</serial>
Oct 26 17:13:29 user nova-compute[75113]:     </disk>
Oct 26 17:13:29 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:13:29 user nova-compute[75113]:       <mac address="fa:16:3e:3b:b4:50"/>
Oct 26 17:13:29 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:13:29 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:13:29 user nova-compute[75113]:       <target dev="tapdc4cb377-3b"/>
Oct 26 17:13:29 user nova-compute[75113]:     </interface>
Oct 26 17:13:29 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:13:29 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/644032e4-b692-4608-9fd2-f1c609fd766d/console.log" append="off"/>
Oct 26 17:13:29 user nova-compute[75113]:     </serial>
Oct 26 17:13:29 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:13:29 user nova-compute[75113]:     <video>
Oct 26 17:13:29 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:13:29 user nova-compute[75113]:     </video>
Oct 26 17:13:29 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:13:29 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:13:29 user nova-compute[75113]:     </rng>
Oct 26 17:13:29 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:13:29 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:13:29 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:13:29 user nova-compute[75113]:     </memballoon>
Oct 26 17:13:29 user nova-compute[75113]:   </devices>
Oct 26 17:13:29 user nova-compute[75113]: </domain>
Oct 26 17:13:29 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-93320350',display_name='tempest-ServerActionsTestOtherA-server-93320350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-93320350',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJUID7/sgaW7v1qEz5yD7qPGwhwC+8ZuDRQIBbpLrTvyGuQpgvdE4GCh2rNno39iufUQMngc4uPWtbJQKyjANVZtkRT2aaUI7mWC3EKIsR7qjErlpC+wkdFBgM3eTSeRw==',key_name='tempest-keypair-536776118',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-yzll3wm0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=644032e4-b692-4608-9fd2-f1c609fd766d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2046108746-network", "vif_mac": "fa:16:3e:3b:b4:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2046108746-network", "vif_mac": "fa:16:3e:3b:b4:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_vif [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2721ae23-acf4-5d7b-a07d-c805bccf63a7', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbc1e91-76c3-44d7-9f4e-ff9232076237]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc4cb377-3b, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc4cb377-3b, col_values=(('qos', UUID('4483f7d2-d0ca-4d41-82d4-a2d9e54951cb')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc4cb377-3b, col_values=(('external_ids', {'iface-id': 'dc4cb377-3bfa-4500-bbb9-a86c6fc30a64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:b4:50', 'vm-uuid': '644032e4-b692-4608-9fd2-f1c609fd766d'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdde8846-923f-4900-ad57-62f34b571eb1]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EqoTPlth {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:29 user nova-compute[75113]: INFO os_vif [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b')
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EqoTPlth" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1169c879-849c-4529-beec-ec3811ef4ee6]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EqoTPlth'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cbab50-57a3-4776-a16f-5fd2eafb4f0d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[81826c3c-ee31-48ac-8c2e-b6f06a086f36]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:29 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:29 user nova-compute[75113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:29 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:29 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:29 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:29 user nova-compute[75113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:29 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:29 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.162s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] HCTL ('33', '0', '0', 0) found on session 29 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] No VIF found with MAC fa:16:3e:3b:b4:50, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[acde9735-9a08-4131-ac3a-4efb1032250b]: (4, ('0 0 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Searching for a device in session 29 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqoTPlth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.187s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26535346437393037', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535346437393037', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:10:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-434832296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-434832296',id=31,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-k69bz2e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:11:37Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=60b00b94-8e37-489a-a061-7cd123289b5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "vif_mac": "fa:16:3e:b3:78:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "vif_mac": "fa:16:3e:b3:78:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:78:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ff9cdd9-d82f-4214-a51a-73c52e25ab65,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff9cdd9-d8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.objects.instance [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'pci_devices' on Instance uuid 60b00b94-8e37-489a-a061-7cd123289b5d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.objects.base [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Object Instance<60b00b94-8e37-489a-a061-7cd123289b5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:13:29 user nova-compute[75113]:   <uuid>60b00b94-8e37-489a-a061-7cd123289b5d</uuid>
Oct 26 17:13:29 user nova-compute[75113]:   <name>instance-0000001f</name>
Oct 26 17:13:29 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:13:29 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:13:29 user nova-compute[75113]:   <metadata>
Oct 26 17:13:29 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:13:29 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:13:29 user nova-compute[75113]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-434832296</nova:name>
Oct 26 17:13:29 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:13:28</nova:creationTime>
Oct 26 17:13:29 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:13:29 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:13:29 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:13:29 user nova-compute[75113]:       <nova:owner>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:user uuid="c431350f06fd4dbf8d74835f34626ee7">tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member</nova:user>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:project uuid="9ae5d124cb054dfbbe04433a685903bc">tempest-ServerBootFromVolumeStableRescueTest-2080298495</nova:project>
Oct 26 17:13:29 user nova-compute[75113]:       </nova:owner>
Oct 26 17:13:29 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:13:29 user nova-compute[75113]:       <nova:ports>
Oct 26 17:13:29 user nova-compute[75113]:         <nova:port uuid="4ff9cdd9-d82f-4214-a51a-73c52e25ab65">
Oct 26 17:13:29 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 17:13:29 user nova-compute[75113]:         </nova:port>
Oct 26 17:13:29 user nova-compute[75113]:       </nova:ports>
Oct 26 17:13:29 user nova-compute[75113]:     </nova:instance>
Oct 26 17:13:29 user nova-compute[75113]:   </metadata>
Oct 26 17:13:29 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:13:29 user nova-compute[75113]:     <system>
Oct 26 17:13:29 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:13:29 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:13:29 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:13:29 user nova-compute[75113]:       <entry name="serial">60b00b94-8e37-489a-a061-7cd123289b5d</entry>
Oct 26 17:13:29 user nova-compute[75113]:       <entry name="uuid">60b00b94-8e37-489a-a061-7cd123289b5d</entry>
Oct 26 17:13:29 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:13:29 user nova-compute[75113]:     </system>
Oct 26 17:13:29 user nova-compute[75113]:   </sysinfo>
Oct 26 17:13:29 user nova-compute[75113]:   <os>
Oct 26 17:13:29 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:13:29 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:13:29 user nova-compute[75113]:   </os>
Oct 26 17:13:29 user nova-compute[75113]:   <features>
Oct 26 17:13:29 user nova-compute[75113]:     <acpi/>
Oct 26 17:13:29 user nova-compute[75113]:     <apic/>
Oct 26 17:13:29 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:13:29 user nova-compute[75113]:   </features>
Oct 26 17:13:29 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:13:29 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:13:29 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:13:29 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:13:29 user nova-compute[75113]:   </clock>
Oct 26 17:13:29 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:13:29 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:13:29 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:13:29 user nova-compute[75113]:   </cpu>
Oct 26 17:13:29 user nova-compute[75113]:   <devices>
Oct 26 17:13:29 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:13:29 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:13:29 user nova-compute[75113]:       <source dev="/dev/sdb"/>
Oct 26 17:13:29 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:13:29 user nova-compute[75113]:       <serial>feedeeb4-1371-440a-93f0-d1f973499143</serial>
Oct 26 17:13:29 user nova-compute[75113]:     </disk>
Oct 26 17:13:29 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:13:29 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:13:29 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.rescue"/>
Oct 26 17:13:29 user nova-compute[75113]:       <target dev="vdb" bus="virtio"/>
Oct 26 17:13:29 user nova-compute[75113]:       <boot order="1"/>
Oct 26 17:13:29 user nova-compute[75113]:     </disk>
Oct 26 17:13:29 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:13:29 user nova-compute[75113]:       <mac address="fa:16:3e:b3:78:d7"/>
Oct 26 17:13:29 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:13:29 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:13:29 user nova-compute[75113]:       <target dev="tap4ff9cdd9-d8"/>
Oct 26 17:13:29 user nova-compute[75113]:     </interface>
Oct 26 17:13:29 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:13:29 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/console.log" append="off"/>
Oct 26 17:13:29 user nova-compute[75113]:     </serial>
Oct 26 17:13:29 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:13:29 user nova-compute[75113]:     <video>
Oct 26 17:13:29 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:13:29 user nova-compute[75113]:     </video>
Oct 26 17:13:29 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:13:29 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:13:29 user nova-compute[75113]:     </rng>
Oct 26 17:13:29 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:13:29 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:13:29 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:13:29 user nova-compute[75113]:     </memballoon>
Oct 26 17:13:29 user nova-compute[75113]:   </devices>
Oct 26 17:13:29 user nova-compute[75113]: </domain>
Oct 26 17:13:29 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:13:29 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Instance destroyed successfully.
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:13:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] No VIF found with MAC fa:16:3e:b3:78:d7, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG nova.compute.manager [req-4b3310f7-5f60-4c53-b56e-741163d2dbd8 req-a8c7934f-9571-452e-8747-e8b11213c1c3 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received event network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4b3310f7-5f60-4c53-b56e-741163d2dbd8 req-a8c7934f-9571-452e-8747-e8b11213c1c3 service nova] Acquiring lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4b3310f7-5f60-4c53-b56e-741163d2dbd8 req-a8c7934f-9571-452e-8747-e8b11213c1c3 service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4b3310f7-5f60-4c53-b56e-741163d2dbd8 req-a8c7934f-9571-452e-8747-e8b11213c1c3 service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG nova.compute.manager [req-4b3310f7-5f60-4c53-b56e-741163d2dbd8 req-a8c7934f-9571-452e-8747-e8b11213c1c3 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] No waiting events found dispatching network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:13:32 user nova-compute[75113]: WARNING nova.compute.manager [req-4b3310f7-5f60-4c53-b56e-741163d2dbd8 req-a8c7934f-9571-452e-8747-e8b11213c1c3 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received unexpected event network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 for instance with vm_state active and task_state resize_finish.
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received event network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] Acquiring lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] No waiting events found dispatching network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:13:34 user nova-compute[75113]: WARNING nova.compute.manager [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received unexpected event network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 for instance with vm_state active and task_state resize_finish.
Oct 26 17:13:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] No waiting events found dispatching network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:13:34 user nova-compute[75113]: WARNING nova.compute.manager [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received unexpected event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 for instance with vm_state active and task_state rescuing.
Oct 26 17:13:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] No waiting events found dispatching network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:13:34 user nova-compute[75113]: WARNING nova.compute.manager [req-e79019f9-ecff-4b64-969b-451fdfeb68d1 req-90893d8c-f465-4dbc-a975-5a296de6f811 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received unexpected event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 for instance with vm_state active and task_state rescuing.
Oct 26 17:13:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG nova.objects.instance [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'flavor' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquired lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG nova.network.neutron [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG nova.objects.instance [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'info_cache' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:34 user nova-compute[75113]: DEBUG nova.objects.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.compute.manager [None req-36a67af8-9aa6-40e3-9416-2c90918a6db1 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:13:35 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Instance running successfully.
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Failed to set time: agent not configured {{(pid=75113) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-5df605f9-f320-49c9-b70c-e148ed16f9e9 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] finish_migration finished successfully. {{(pid=75113) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.compute.manager [req-59a235f4-be68-4fd7-afb4-d92c992949b7 req-78f0674d-aea2-4ea4-b53d-ff7e8fe5e63a service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-changed-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.compute.manager [req-59a235f4-be68-4fd7-afb4-d92c992949b7 req-78f0674d-aea2-4ea4-b53d-ff7e8fe5e63a service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Refreshing instance network info cache due to event network-changed-1dc2c484-d507-4733-8b3f-90f89494e166. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-59a235f4-be68-4fd7-afb4-d92c992949b7 req-78f0674d-aea2-4ea4-b53d-ff7e8fe5e63a service nova] Acquiring lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-59a235f4-be68-4fd7-afb4-d92c992949b7 req-78f0674d-aea2-4ea4-b53d-ff7e8fe5e63a service nova] Acquired lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.network.neutron [req-59a235f4-be68-4fd7-afb4-d92c992949b7 req-78f0674d-aea2-4ea4-b53d-ff7e8fe5e63a service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Refreshing network info cache for port 1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'flavor' on Instance uuid 296a09d4-ed82-4876-9fbd-baadff6a7b4d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.network.neutron [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Updating instance_info_cache with network_info: [{"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Releasing lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:13:35 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: e216e427-7231-4491-85f8-607c930e0d43] Instance destroyed successfully.
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.objects.instance [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'resources' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.objects.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1800361624',display_name='tempest-AttachVolumeTestJSON-server-1800361624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1800361624',id=30,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM0mtS1dljg4Qu1gGqqTeuT9mq/sIHwVu/5XUkXKrM/OqcCuxLS9BGabMHGaDAN2pPR3pksc+bfFVi23MZQGdlYQu9QfNjCvEVQbShJMteVLFo3IenVFiQim0F4GoqwcQ==',key_name='tempest-keypair-618389938',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ecfe1e4023f641d6b492c7a0d0fc033b',ramdisk_id='',reservation_id='r-hj3gqi9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1430222675',owner_user_name='tempest-AttachVolumeTestJSON-1430222675-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b04592754c6c406e9d550e9036fe9ea7',uuid=e216e427-7231-4491-85f8-607c930e0d43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converting VIF {"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_vif [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab4b54e0-28, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c081a8a0-9b32-4daf-a243-4159f420a76b) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:13:35 user nova-compute[75113]: INFO os_vif [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28')
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npCXrgbf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:13:35 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[be368bd8-89e8-4327-af42-920146fc8e9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:13:35 user nova-compute[75113]: No targets found.
Oct 26 17:13:35 user nova-compute[75113]: iSNS:
Oct 26 17:13:35 user nova-compute[75113]: No targets found.
Oct 26 17:13:35 user nova-compute[75113]: STATIC:
Oct 26 17:13:35 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143
Oct 26 17:13:35 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:13:35 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:13:35 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158
Oct 26 17:13:35 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:13:35 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:13:35 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:13:35 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:13:35 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:13:35 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72
Oct 26 17:13:35 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:13:35 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:13:35 user nova-compute[75113]: FIRMWARE:
Oct 26 17:13:35 user nova-compute[75113]: No targets found.
Oct 26 17:13:35 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:13:35 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:13:35 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:35 user nova-compute[75113]: INFO nova.compute.manager [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Attaching volume 1cc7688c-674a-43dd-b9ec-936cd0d5dbdf to /dev/vdb
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f383e2-1f51-42d1-87ce-ba0753cd8e5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[df804f8f-31ad-4854-8a9e-40d6e748a328]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:35 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:35 user nova-compute[75113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:35 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:35 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:35 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:35 user nova-compute[75113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:35 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:35 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f491411b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158'): ({'sde'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Removing single pathed devices sde {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7585a851-9aff-4ee5-9919-229220a3d00f]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0c913d-247d-43c3-ab75-1764be1874bb]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Flushing IO for device /dev/sde {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08d56d8-680d-4670-8920-57e3a9d619e5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.utils [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0f24b0-7354-4369-a6c6-021a48b74178]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7badd670-3ded-4b9a-a580-00e3a915f6b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75f9a38-1e3a-4bcb-a05d-050a2ed33d18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2d1b2d-39d0-4539-a330-bdd54d7bce35]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a51889-578a-40e2-a134-a1012f485a8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7853388-2130-465a-9804-43ceb3b16a4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb98ed4-ac57-418a-97c9-47de4246fbb9]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260]
Oct 26 17:13:35 user nova-compute[75113]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260] successful.
Oct 26 17:13:35 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:13:35 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3a1045-abdc-4ae6-992d-156e5ea784a6]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.utils [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updating existing volume attachment record: 26919008-588e-416c-a5dd-874c24a7dea7 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee700bc1-ad52-4563-8d5b-7dda68a70768]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] <== disconnect_volume: return (410ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Start _get_guest_xml network_info=[{"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '329ed4ea-0c88-43d5-b09b-c11b1c4b17ee', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npCXrgbf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'e216e427-7231-4491-85f8-607c930e0d43', 'attached_at': '', 'detached_at': '', 'volume_id': '90759f59-0815-4d3a-9437-c60888b23158', 'serial': '90759f59-0815-4d3a-9437-c60888b23158'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.objects.instance [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'numa_topology' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.objects.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:13:36 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:13:36 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.objects.instance [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'vcpu_model' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.network.neutron [req-59a235f4-be68-4fd7-afb4-d92c992949b7 req-78f0674d-aea2-4ea4-b53d-ff7e8fe5e63a service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updated VIF entry in instance network info cache for port 1dc2c484-d507-4733-8b3f-90f89494e166. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.network.neutron [req-59a235f4-be68-4fd7-afb4-d92c992949b7 req-78f0674d-aea2-4ea4-b53d-ff7e8fe5e63a service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updating instance_info_cache with network_info: [{"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.objects.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npCXrgbf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:13:36 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:13:36 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:13:36 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-59a235f4-be68-4fd7-afb4-d92c992949b7 req-78f0674d-aea2-4ea4-b53d-ff7e8fe5e63a service nova] Releasing lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a664c8e1-3907-4b6d-b594-5fbe2ac931d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:13:36 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3021b16-03ce-4742-9519-1837d3ffee94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158] added
Oct 26 17:13:36 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa604ce8-b81f-4d31-ac20-8b857f55b8bb]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[de612897-614b-406f-97e0-cf9c91ab1bd7]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npCXrgbf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npCXrgbf" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[419c91db-ca54-49fc-b8e6-b677fe904dbd]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'npCXrgbf'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c34569-4db3-4892-a5d8-cd91a0606f1e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cc6498-2726-4d25-b38a-46b34f6ea341]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:36 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:36 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:36 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:36 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:36 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:36 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c877e0-165a-494d-b705-ee3c91dc84be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260]
Oct 26 17:13:36 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260] successful.
Oct 26 17:13:36 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34901349-a24e-4d97-ab92-95f241e84703]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b8d116-fb89-415b-805b-6f6ce1bee89f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:36 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:36 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:36 user nova-compute[75113]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:36 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:36 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:36 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:36 user nova-compute[75113]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:36 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaa950a-06d5-4d01-8ab0-b4bee78197a4]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:13:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npCXrgbf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26238653035363134', 'path': '/dev/sde'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238653035363134', 'path': '/dev/sde'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1800361624',display_name='tempest-AttachVolumeTestJSON-server-1800361624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1800361624',id=30,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM0mtS1dljg4Qu1gGqqTeuT9mq/sIHwVu/5XUkXKrM/OqcCuxLS9BGabMHGaDAN2pPR3pksc+bfFVi23MZQGdlYQu9QfNjCvEVQbShJMteVLFo3IenVFiQim0F4GoqwcQ==',key_name='tempest-keypair-618389938',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ecfe1e4023f641d6b492c7a0d0fc033b',ramdisk_id='',reservation_id='r-hj3gqi9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1430222675',owner_user_name='tempest-AttachVolumeTestJSON-1430222675-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b04592754c6c406e9d550e9036fe9ea7',uuid=e216e427-7231-4491-85f8-607c930e0d43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converting VIF {"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG nova.objects.instance [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'pci_devices' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG nova.objects.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:13:37 user nova-compute[75113]:   <uuid>e216e427-7231-4491-85f8-607c930e0d43</uuid>
Oct 26 17:13:37 user nova-compute[75113]:   <name>instance-0000001e</name>
Oct 26 17:13:37 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:13:37 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:13:37 user nova-compute[75113]:   <metadata>
Oct 26 17:13:37 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:13:37 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:13:37 user nova-compute[75113]:       <nova:name>tempest-AttachVolumeTestJSON-server-1800361624</nova:name>
Oct 26 17:13:37 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:13:36</nova:creationTime>
Oct 26 17:13:37 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:13:37 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:13:37 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:13:37 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:13:37 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:13:37 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:13:37 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:13:37 user nova-compute[75113]:       <nova:owner>
Oct 26 17:13:37 user nova-compute[75113]:         <nova:user uuid="b04592754c6c406e9d550e9036fe9ea7">tempest-AttachVolumeTestJSON-1430222675-project-member</nova:user>
Oct 26 17:13:37 user nova-compute[75113]:         <nova:project uuid="ecfe1e4023f641d6b492c7a0d0fc033b">tempest-AttachVolumeTestJSON-1430222675</nova:project>
Oct 26 17:13:37 user nova-compute[75113]:       </nova:owner>
Oct 26 17:13:37 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:13:37 user nova-compute[75113]:       <nova:ports>
Oct 26 17:13:37 user nova-compute[75113]:         <nova:port uuid="ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8">
Oct 26 17:13:37 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 17:13:37 user nova-compute[75113]:         </nova:port>
Oct 26 17:13:37 user nova-compute[75113]:       </nova:ports>
Oct 26 17:13:37 user nova-compute[75113]:     </nova:instance>
Oct 26 17:13:37 user nova-compute[75113]:   </metadata>
Oct 26 17:13:37 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:13:37 user nova-compute[75113]:     <system>
Oct 26 17:13:37 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:13:37 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:13:37 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:13:37 user nova-compute[75113]:       <entry name="serial">e216e427-7231-4491-85f8-607c930e0d43</entry>
Oct 26 17:13:37 user nova-compute[75113]:       <entry name="uuid">e216e427-7231-4491-85f8-607c930e0d43</entry>
Oct 26 17:13:37 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:13:37 user nova-compute[75113]:     </system>
Oct 26 17:13:37 user nova-compute[75113]:   </sysinfo>
Oct 26 17:13:37 user nova-compute[75113]:   <os>
Oct 26 17:13:37 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:13:37 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:13:37 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:13:37 user nova-compute[75113]:   </os>
Oct 26 17:13:37 user nova-compute[75113]:   <features>
Oct 26 17:13:37 user nova-compute[75113]:     <acpi/>
Oct 26 17:13:37 user nova-compute[75113]:     <apic/>
Oct 26 17:13:37 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:13:37 user nova-compute[75113]:   </features>
Oct 26 17:13:37 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:13:37 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:13:37 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:13:37 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:13:37 user nova-compute[75113]:   </clock>
Oct 26 17:13:37 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:13:37 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:13:37 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:13:37 user nova-compute[75113]:   </cpu>
Oct 26 17:13:37 user nova-compute[75113]:   <devices>
Oct 26 17:13:37 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:13:37 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:13:37 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk"/>
Oct 26 17:13:37 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:13:37 user nova-compute[75113]:     </disk>
Oct 26 17:13:37 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:13:37 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:13:37 user nova-compute[75113]:       <source dev="/dev/sde"/>
Oct 26 17:13:37 user nova-compute[75113]:       <target dev="vdb" bus="virtio"/>
Oct 26 17:13:37 user nova-compute[75113]:       <serial>90759f59-0815-4d3a-9437-c60888b23158</serial>
Oct 26 17:13:37 user nova-compute[75113]:     </disk>
Oct 26 17:13:37 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:13:37 user nova-compute[75113]:       <mac address="fa:16:3e:d6:32:fd"/>
Oct 26 17:13:37 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:13:37 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:13:37 user nova-compute[75113]:       <target dev="tapab4b54e0-28"/>
Oct 26 17:13:37 user nova-compute[75113]:     </interface>
Oct 26 17:13:37 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:13:37 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/console.log" append="off"/>
Oct 26 17:13:37 user nova-compute[75113]:     </serial>
Oct 26 17:13:37 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:13:37 user nova-compute[75113]:     <video>
Oct 26 17:13:37 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:13:37 user nova-compute[75113]:     </video>
Oct 26 17:13:37 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:13:37 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:13:37 user nova-compute[75113]:     </rng>
Oct 26 17:13:37 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:13:37 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:13:37 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:13:37 user nova-compute[75113]:     </memballoon>
Oct 26 17:13:37 user nova-compute[75113]:   </devices>
Oct 26 17:13:37 user nova-compute[75113]: </domain>
Oct 26 17:13:37 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG nova.objects.instance [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'trusted_certs' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG nova.objects.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.216s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Cannot resize image /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG nova.objects.instance [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'migration_context' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG nova.objects.base [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1800361624',display_name='tempest-AttachVolumeTestJSON-server-1800361624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1800361624',id=30,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM0mtS1dljg4Qu1gGqqTeuT9mq/sIHwVu/5XUkXKrM/OqcCuxLS9BGabMHGaDAN2pPR3pksc+bfFVi23MZQGdlYQu9QfNjCvEVQbShJMteVLFo3IenVFiQim0F4GoqwcQ==',key_name='tempest-keypair-618389938',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ecfe1e4023f641d6b492c7a0d0fc033b',ramdisk_id='',reservation_id='r-hj3gqi9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1430222675',owner_user_name='tempest-AttachVolumeTestJSON-1430222675-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b04592754c6c406e9d550e9036fe9ea7',uuid=e216e427-7231-4491-85f8-607c930e0d43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converting VIF {"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG os_vif [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '896bf060-4b82-54dd-9a9d-1bfb5c42f794', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab4b54e0-28, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab4b54e0-28, col_values=(('qos', UUID('b07a059e-b9d3-4d95-9c9f-5265842dac1c')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab4b54e0-28, col_values=(('external_ids', {'iface-id': 'ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:32:fd', 'vm-uuid': 'e216e427-7231-4491-85f8-607c930e0d43'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:13:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:38 user nova-compute[75113]: INFO os_vif [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28')
Oct 26 17:13:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:40 user nova-compute[75113]: DEBUG nova.compute.manager [req-534eb4f3-a1a3-475b-8f3d-1dc090d1c66f req-8294ddfd-cb27-46c4-aa5a-b03c781e2846 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:13:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-534eb4f3-a1a3-475b-8f3d-1dc090d1c66f req-8294ddfd-cb27-46c4-aa5a-b03c781e2846 service nova] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-534eb4f3-a1a3-475b-8f3d-1dc090d1c66f req-8294ddfd-cb27-46c4-aa5a-b03c781e2846 service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-534eb4f3-a1a3-475b-8f3d-1dc090d1c66f req-8294ddfd-cb27-46c4-aa5a-b03c781e2846 service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:40 user nova-compute[75113]: DEBUG nova.compute.manager [req-534eb4f3-a1a3-475b-8f3d-1dc090d1c66f req-8294ddfd-cb27-46c4-aa5a-b03c781e2846 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] No waiting events found dispatching network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:13:40 user nova-compute[75113]: WARNING nova.compute.manager [req-534eb4f3-a1a3-475b-8f3d-1dc090d1c66f req-8294ddfd-cb27-46c4-aa5a-b03c781e2846 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received unexpected event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 for instance with vm_state stopped and task_state powering-on.
Oct 26 17:13:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:42 user nova-compute[75113]: DEBUG nova.compute.manager [req-6c017d6e-1956-428c-b9f5-e9881c886cd9 req-1ec5d6b2-00a9-44a0-893e-9bbbf3c53dfd service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:13:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6c017d6e-1956-428c-b9f5-e9881c886cd9 req-1ec5d6b2-00a9-44a0-893e-9bbbf3c53dfd service nova] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:13:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6c017d6e-1956-428c-b9f5-e9881c886cd9 req-1ec5d6b2-00a9-44a0-893e-9bbbf3c53dfd service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:13:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6c017d6e-1956-428c-b9f5-e9881c886cd9 req-1ec5d6b2-00a9-44a0-893e-9bbbf3c53dfd service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:13:42 user nova-compute[75113]: DEBUG nova.compute.manager [req-6c017d6e-1956-428c-b9f5-e9881c886cd9 req-1ec5d6b2-00a9-44a0-893e-9bbbf3c53dfd service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] No waiting events found dispatching network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:13:42 user nova-compute[75113]: WARNING nova.compute.manager [req-6c017d6e-1956-428c-b9f5-e9881c886cd9 req-1ec5d6b2-00a9-44a0-893e-9bbbf3c53dfd service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received unexpected event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 for instance with vm_state stopped and task_state powering-on.
Oct 26 17:13:42 user nova-compute[75113]: DEBUG nova.compute.manager [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:13:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: e216e427-7231-4491-85f8-607c930e0d43] Instance rebooted successfully.
Oct 26 17:13:42 user nova-compute[75113]: DEBUG nova.compute.manager [None req-46ed9859-2252-4dfb-9c06-8de230c11a69 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:13:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FCIwdoKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:13:58 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:13:58 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:13:58 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:13:58 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:13:58 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[96206795-138a-47af-afb6-5b7639bfcbc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:13:58 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8fe208-ad80-49c7-afe6-7add3247b9f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf] added
Oct 26 17:13:58 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[796d788b-2d5f-4ecd-b281-bef48f87dc75]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee753e0-07d2-4126-bbdf-6ace73943e81]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FCIwdoKn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FCIwdoKn" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae667eff-6f0d-4dd2-b82f-e2dd42c363dc]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FCIwdoKn'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e522b4d-f25a-4dee-aa89-3005cf70c500]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:58 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f436739d-8e89-472d-82bc-e2c09c95ae5d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241fc8c0-7f14-4df5-8c6c-bc81fa5ce022 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241fc8c0-7f14-4df5-8c6c-bc81fa5ce022 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241fc8c0-7f14-4df5-8c6c-bc81fa5ce022 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e591c937-55bc-4658-860c-42e59ecb6c36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf, portal: 172.16.0.220,3260]
Oct 26 17:13:59 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf, portal: 172.16.0.220,3260] successful.
Oct 26 17:13:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8a4740-48ef-4516-be5b-14c183e50bd5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d89a92-0e97-42a6-a507-4ea7c281a869]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241fc8c0-7f14-4df5-8c6c-bc81fa5ce022 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241fc8c0-7f14-4df5-8c6c-bc81fa5ce022 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)
Oct 26 17:13:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241fc8c0-7f14-4df5-8c6c-bc81fa5ce022 (non-flash)
Oct 26 17:13:59 user nova-compute[75113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)
Oct 26 17:13:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.052s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb3479e-7412-418f-aa44-92c9daaa91eb]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:13:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FCIwdoKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:14:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:14:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '23066373961653065', 'path': '/dev/sdg'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:14:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066373961653065', 'path': '/dev/sdg'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:14:00 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'flavor' on Instance uuid 296a09d4-ed82-4876-9fbd-baadff6a7b4d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:14:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:14:00 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:14:00 user nova-compute[75113]:   <source dev="/dev/sdg"/>
Oct 26 17:14:00 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:14:00 user nova-compute[75113]:   <serial>1cc7688c-674a-43dd-b9ec-936cd0d5dbdf</serial>
Oct 26 17:14:00 user nova-compute[75113]: </disk>
Oct 26 17:14:00 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:14:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:14:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:14:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No VIF found with MAC fa:16:3e:75:78:27, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:14:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b26341a-18fc-40f4-8b8b-dda05da2b670 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.340s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:14:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:02 user nova-compute[75113]: INFO nova.compute.manager [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Rescuing
Oct 26 17:14:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:14:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquired lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:14:02 user nova-compute[75113]: DEBUG nova.network.neutron [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:14:02 user nova-compute[75113]: DEBUG nova.network.neutron [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updating instance_info_cache with network_info: [{"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:14:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Releasing lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-a4b57559-79a0-4cd2-9219-0582e5227d45 req-865769ab-0206-4874-9eca-e85ac35dd2c9 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-unplugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a4b57559-79a0-4cd2-9219-0582e5227d45 req-865769ab-0206-4874-9eca-e85ac35dd2c9 service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a4b57559-79a0-4cd2-9219-0582e5227d45 req-865769ab-0206-4874-9eca-e85ac35dd2c9 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a4b57559-79a0-4cd2-9219-0582e5227d45 req-865769ab-0206-4874-9eca-e85ac35dd2c9 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-a4b57559-79a0-4cd2-9219-0582e5227d45 req-865769ab-0206-4874-9eca-e85ac35dd2c9 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-unplugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:14:03 user nova-compute[75113]: WARNING nova.compute.manager [req-a4b57559-79a0-4cd2-9219-0582e5227d45 req-865769ab-0206-4874-9eca-e85ac35dd2c9 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-unplugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state active and task_state rescuing.
Oct 26 17:14:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:03 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Instance destroyed successfully.
Oct 26 17:14:03 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Attempting rescue
Oct 26 17:14:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75113) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Instance directory exists: not creating {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 17:14:03 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Creating image(s)
Oct 26 17:14:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "/opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "/opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "/opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG nova.objects.instance [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'trusted_certs' on Instance uuid 296a09d4-ed82-4876-9fbd-baadff6a7b4d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:14:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.263s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.rescue {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.rescue" returned: 0 in 0.057s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'migration_context' on Instance uuid 296a09d4-ed82-4876-9fbd-baadff6a7b4d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.objects.base [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<296a09d4-ed82-4876-9fbd-baadff6a7b4d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Start _get_guest_xml network_info=[{"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "vif_mac": "fa:16:3e:75:78:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '91603055-2c31-464d-bb00-ae160ab6e467', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'resources' on Instance uuid 296a09d4-ed82-4876-9fbd-baadff6a7b4d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.objects.base [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<296a09d4-ed82-4876-9fbd-baadff6a7b4d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'numa_topology' on Instance uuid 296a09d4-ed82-4876-9fbd-baadff6a7b4d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.objects.base [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<296a09d4-ed82-4876-9fbd-baadff6a7b4d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:14:04 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:14:04 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'vcpu_model' on Instance uuid 296a09d4-ed82-4876-9fbd-baadff6a7b4d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.objects.base [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<296a09d4-ed82-4876-9fbd-baadff6a7b4d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-171939011',display_name='tempest-ServerRescueNegativeTestJSON-server-171939011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-171939011',id=34,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz8QcdD1FR7/sQvuOZPE6yIwPGirxc4CN6QX5R+wZD/RSeomRaSXT5JTGKOpbc8DTjBxJsSxt56JvBM7TyteiBKrqg33rwF5tZW6dy/Rjbi3A18gcFNDKc5E41jE9Rtig==',key_name='tempest-keypair-147762484',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:11:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d11c5d88b2f4a45acee2e9c7d26043a',ramdisk_id='',reservation_id='r-jyqvj4zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760587308',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760587308-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa8e21aab014ce6ace0109878275b8f',uuid=296a09d4-ed82-4876-9fbd-baadff6a7b4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "vif_mac": "fa:16:3e:75:78:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converting VIF {"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "vif_mac": "fa:16:3e:75:78:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:78:27,bridge_name='br-int',has_traffic_filtering=True,id=1dc2c484-d507-4733-8b3f-90f89494e166,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc2c484-d5') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'pci_devices' on Instance uuid 296a09d4-ed82-4876-9fbd-baadff6a7b4d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.objects.base [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Object Instance<296a09d4-ed82-4876-9fbd-baadff6a7b4d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:14:04 user nova-compute[75113]:   <uuid>296a09d4-ed82-4876-9fbd-baadff6a7b4d</uuid>
Oct 26 17:14:04 user nova-compute[75113]:   <name>instance-00000022</name>
Oct 26 17:14:04 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:14:04 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:14:04 user nova-compute[75113]:   <metadata>
Oct 26 17:14:04 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:14:04 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:14:04 user nova-compute[75113]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-171939011</nova:name>
Oct 26 17:14:04 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:14:04</nova:creationTime>
Oct 26 17:14:04 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:14:04 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:14:04 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:14:04 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:14:04 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:14:04 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:14:04 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:14:04 user nova-compute[75113]:       <nova:owner>
Oct 26 17:14:04 user nova-compute[75113]:         <nova:user uuid="5aa8e21aab014ce6ace0109878275b8f">tempest-ServerRescueNegativeTestJSON-1760587308-project-member</nova:user>
Oct 26 17:14:04 user nova-compute[75113]:         <nova:project uuid="2d11c5d88b2f4a45acee2e9c7d26043a">tempest-ServerRescueNegativeTestJSON-1760587308</nova:project>
Oct 26 17:14:04 user nova-compute[75113]:       </nova:owner>
Oct 26 17:14:04 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:14:04 user nova-compute[75113]:       <nova:ports>
Oct 26 17:14:04 user nova-compute[75113]:         <nova:port uuid="1dc2c484-d507-4733-8b3f-90f89494e166">
Oct 26 17:14:04 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 17:14:04 user nova-compute[75113]:         </nova:port>
Oct 26 17:14:04 user nova-compute[75113]:       </nova:ports>
Oct 26 17:14:04 user nova-compute[75113]:     </nova:instance>
Oct 26 17:14:04 user nova-compute[75113]:   </metadata>
Oct 26 17:14:04 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:14:04 user nova-compute[75113]:     <system>
Oct 26 17:14:04 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:14:04 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:14:04 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:14:04 user nova-compute[75113]:       <entry name="serial">296a09d4-ed82-4876-9fbd-baadff6a7b4d</entry>
Oct 26 17:14:04 user nova-compute[75113]:       <entry name="uuid">296a09d4-ed82-4876-9fbd-baadff6a7b4d</entry>
Oct 26 17:14:04 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:14:04 user nova-compute[75113]:     </system>
Oct 26 17:14:04 user nova-compute[75113]:   </sysinfo>
Oct 26 17:14:04 user nova-compute[75113]:   <os>
Oct 26 17:14:04 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:14:04 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:14:04 user nova-compute[75113]:   </os>
Oct 26 17:14:04 user nova-compute[75113]:   <features>
Oct 26 17:14:04 user nova-compute[75113]:     <acpi/>
Oct 26 17:14:04 user nova-compute[75113]:     <apic/>
Oct 26 17:14:04 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:14:04 user nova-compute[75113]:   </features>
Oct 26 17:14:04 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:14:04 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:14:04 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:14:04 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:14:04 user nova-compute[75113]:   </clock>
Oct 26 17:14:04 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:14:04 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:14:04 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:14:04 user nova-compute[75113]:   </cpu>
Oct 26 17:14:04 user nova-compute[75113]:   <devices>
Oct 26 17:14:04 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:14:04 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:14:04 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.rescue"/>
Oct 26 17:14:04 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:14:04 user nova-compute[75113]:     </disk>
Oct 26 17:14:04 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:14:04 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:14:04 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk"/>
Oct 26 17:14:04 user nova-compute[75113]:       <target dev="vdb" bus="virtio"/>
Oct 26 17:14:04 user nova-compute[75113]:     </disk>
Oct 26 17:14:04 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:14:04 user nova-compute[75113]:       <mac address="fa:16:3e:75:78:27"/>
Oct 26 17:14:04 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:14:04 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:14:04 user nova-compute[75113]:       <target dev="tap1dc2c484-d5"/>
Oct 26 17:14:04 user nova-compute[75113]:     </interface>
Oct 26 17:14:04 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:14:04 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/console.log" append="off"/>
Oct 26 17:14:04 user nova-compute[75113]:     </serial>
Oct 26 17:14:04 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:14:04 user nova-compute[75113]:     <video>
Oct 26 17:14:04 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:14:04 user nova-compute[75113]:     </video>
Oct 26 17:14:04 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:14:04 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:14:04 user nova-compute[75113]:     </rng>
Oct 26 17:14:04 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:14:04 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:14:04 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:14:04 user nova-compute[75113]:     </memballoon>
Oct 26 17:14:04 user nova-compute[75113]:   </devices>
Oct 26 17:14:04 user nova-compute[75113]: </domain>
Oct 26 17:14:04 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:14:04 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Instance destroyed successfully.
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:14:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] No VIF found with MAC fa:16:3e:75:78:27, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:14:05 user nova-compute[75113]: DEBUG nova.compute.manager [req-20b8c4b2-6264-4eb9-b604-3ef680d0cb17 req-f3c6c81f-52e0-4db2-8472-5cec7307e41d service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:14:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-20b8c4b2-6264-4eb9-b604-3ef680d0cb17 req-f3c6c81f-52e0-4db2-8472-5cec7307e41d service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:14:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-20b8c4b2-6264-4eb9-b604-3ef680d0cb17 req-f3c6c81f-52e0-4db2-8472-5cec7307e41d service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:14:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-20b8c4b2-6264-4eb9-b604-3ef680d0cb17 req-f3c6c81f-52e0-4db2-8472-5cec7307e41d service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:14:05 user nova-compute[75113]: DEBUG nova.compute.manager [req-20b8c4b2-6264-4eb9-b604-3ef680d0cb17 req-f3c6c81f-52e0-4db2-8472-5cec7307e41d service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:14:05 user nova-compute[75113]: WARNING nova.compute.manager [req-20b8c4b2-6264-4eb9-b604-3ef680d0cb17 req-f3c6c81f-52e0-4db2-8472-5cec7307e41d service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state active and task_state rescuing.
Oct 26 17:14:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:07 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:14:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-02341884-2f25-46cd-914a-852377db058e req-ad0889d5-52ad-4484-97ea-cfdba3171998 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:14:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-02341884-2f25-46cd-914a-852377db058e req-ad0889d5-52ad-4484-97ea-cfdba3171998 service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:14:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-02341884-2f25-46cd-914a-852377db058e req-ad0889d5-52ad-4484-97ea-cfdba3171998 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:14:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-02341884-2f25-46cd-914a-852377db058e req-ad0889d5-52ad-4484-97ea-cfdba3171998 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:14:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-02341884-2f25-46cd-914a-852377db058e req-ad0889d5-52ad-4484-97ea-cfdba3171998 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:14:07 user nova-compute[75113]: WARNING nova.compute.manager [req-02341884-2f25-46cd-914a-852377db058e req-ad0889d5-52ad-4484-97ea-cfdba3171998 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state active and task_state rescuing.
Oct 26 17:14:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-02341884-2f25-46cd-914a-852377db058e req-ad0889d5-52ad-4484-97ea-cfdba3171998 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:14:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-02341884-2f25-46cd-914a-852377db058e req-ad0889d5-52ad-4484-97ea-cfdba3171998 service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:14:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-02341884-2f25-46cd-914a-852377db058e req-ad0889d5-52ad-4484-97ea-cfdba3171998 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:14:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-02341884-2f25-46cd-914a-852377db058e req-ad0889d5-52ad-4484-97ea-cfdba3171998 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:14:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-02341884-2f25-46cd-914a-852377db058e req-ad0889d5-52ad-4484-97ea-cfdba3171998 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:14:07 user nova-compute[75113]: WARNING nova.compute.manager [req-02341884-2f25-46cd-914a-852377db058e req-ad0889d5-52ad-4484-97ea-cfdba3171998 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state active and task_state rescuing.
Oct 26 17:14:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:09 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:14:10 user nova-compute[75113]: DEBUG nova.compute.manager [None req-710741dd-17d5-4567-b0de-a7f8b14b86dc tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:14:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:14 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:14:14 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:14:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:14:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:14:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:14:14 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:14:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:14:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:14:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:14:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:14:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:14:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:14:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:14:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:18 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:14:18 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:14:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7775MB free_disk=24.942298889160156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:14:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:14:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:14:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Applying migration context for instance 644032e4-b692-4608-9fd2-f1c609fd766d as it has an incoming, in-progress migration 4231cee6-9b97-4f7e-bb2a-37714b34ea73. Migration status is finished {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 17:14:19 user nova-compute[75113]: INFO nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Updating resource usage from migration 4231cee6-9b97-4f7e-bb2a-37714b34ea73
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 7cbb27a2-37c5-4045-a005-719f79f30714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e216e427-7231-4491-85f8-607c930e0d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 60b00b94-8e37-489a-a061-7cd123289b5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Migration 4231cee6-9b97-4f7e-bb2a-37714b34ea73 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 644032e4-b692-4608-9fd2-f1c609fd766d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:14:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.670s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:14:20 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:14:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:14:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:14:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:14:20 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:14:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updating instance_info_cache with network_info: [{"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:14:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-ff2781bd-106d-4cdb-844c-41c58a191a88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:14:21 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:14:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:14:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:14:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:14:21 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:14:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:14:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:14:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:14:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:14:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:14:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:14:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:14:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "644032e4-b692-4608-9fd2-f1c609fd766d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:14:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "644032e4-b692-4608-9fd2-f1c609fd766d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:14:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Going to confirm migration 2 {{(pid=75113) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 26 17:14:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:14:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquired lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:14:53 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:14:53 user nova-compute[75113]: DEBUG nova.objects.instance [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lazy-loading 'info_cache' on Instance uuid 644032e4-b692-4608-9fd2-f1c609fd766d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:14:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:14:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:14:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:14:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:14:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:14:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:14:54 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Updating instance_info_cache with network_info: [{"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:14:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Releasing lock "refresh_cache-644032e4-b692-4608-9fd2-f1c609fd766d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:14:54 user nova-compute[75113]: DEBUG nova.objects.instance [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lazy-loading 'migration_context' on Instance uuid 644032e4-b692-4608-9fd2-f1c609fd766d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:14:54 user nova-compute[75113]: DEBUG nova.objects.base [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Object Instance<644032e4-b692-4608-9fd2-f1c609fd766d> lazy-loaded attributes: info_cache,migration_context {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:14:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:14:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:14:54 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:14:54 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:14:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.422s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:14:55 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Deleted allocation for migration 4231cee6-9b97-4f7e-bb2a-37714b34ea73
Oct 26 17:14:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3112de47-74fa-4bcc-9289-ed60ed5f3a7c tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "644032e4-b692-4608-9fd2-f1c609fd766d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.719s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:14:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:15:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:15:08 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:15:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:15:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:15:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:15:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:15:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:15:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:09 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:15:11 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:15:11 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 17:15:13 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:15:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:15:14 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:15:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:14 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:15:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:15:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:15:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:15:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:16 user nova-compute[75113]: INFO nova.compute.manager [None req-13b540fb-750a-4a8f-a231-4ef4d58b1fcd tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Unrescuing
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-13b540fb-750a-4a8f-a231-4ef4d58b1fcd tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "refresh_cache-60b00b94-8e37-489a-a061-7cd123289b5d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-13b540fb-750a-4a8f-a231-4ef4d58b1fcd tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquired lock "refresh_cache-60b00b94-8e37-489a-a061-7cd123289b5d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG nova.network.neutron [None req-13b540fb-750a-4a8f-a231-4ef4d58b1fcd tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG nova.network.neutron [None req-13b540fb-750a-4a8f-a231-4ef4d58b1fcd tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Updating instance_info_cache with network_info: [{"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-13b540fb-750a-4a8f-a231-4ef4d58b1fcd tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Releasing lock "refresh_cache-60b00b94-8e37-489a-a061-7cd123289b5d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG nova.objects.instance [None req-13b540fb-750a-4a8f-a231-4ef4d58b1fcd tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'flavor' on Instance uuid 60b00b94-8e37-489a-a061-7cd123289b5d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-d8f886b2-d672-4e1e-9afc-24666246f8c3 req-09e608ff-55b5-4eb1-9871-dc9168fb4836 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-unplugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d8f886b2-d672-4e1e-9afc-24666246f8c3 req-09e608ff-55b5-4eb1-9871-dc9168fb4836 service nova] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d8f886b2-d672-4e1e-9afc-24666246f8c3 req-09e608ff-55b5-4eb1-9871-dc9168fb4836 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d8f886b2-d672-4e1e-9afc-24666246f8c3 req-09e608ff-55b5-4eb1-9871-dc9168fb4836 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-d8f886b2-d672-4e1e-9afc-24666246f8c3 req-09e608ff-55b5-4eb1-9871-dc9168fb4836 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] No waiting events found dispatching network-vif-unplugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:15:16 user nova-compute[75113]: WARNING nova.compute.manager [req-d8f886b2-d672-4e1e-9afc-24666246f8c3 req-09e608ff-55b5-4eb1-9871-dc9168fb4836 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received unexpected event network-vif-unplugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:15:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:15:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:17 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Instance destroyed successfully.
Oct 26 17:15:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:15:18 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:15:18 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:15:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7811MB free_disk=24.93179702758789GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:15:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 7cbb27a2-37c5-4045-a005-719f79f30714 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e216e427-7231-4491-85f8-607c930e0d43 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 60b00b94-8e37-489a-a061-7cd123289b5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 644032e4-b692-4608-9fd2-f1c609fd766d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-b8bd3e9b-26f3-4e65-8085-1deb7d423e2e req-af46fe25-aed2-4bc7-a88d-9ad2510433ec service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b8bd3e9b-26f3-4e65-8085-1deb7d423e2e req-af46fe25-aed2-4bc7-a88d-9ad2510433ec service nova] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b8bd3e9b-26f3-4e65-8085-1deb7d423e2e req-af46fe25-aed2-4bc7-a88d-9ad2510433ec service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b8bd3e9b-26f3-4e65-8085-1deb7d423e2e req-af46fe25-aed2-4bc7-a88d-9ad2510433ec service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-b8bd3e9b-26f3-4e65-8085-1deb7d423e2e req-af46fe25-aed2-4bc7-a88d-9ad2510433ec service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] No waiting events found dispatching network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:15:19 user nova-compute[75113]: WARNING nova.compute.manager [req-b8bd3e9b-26f3-4e65-8085-1deb7d423e2e req-af46fe25-aed2-4bc7-a88d-9ad2510433ec service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received unexpected event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-b8bd3e9b-26f3-4e65-8085-1deb7d423e2e req-af46fe25-aed2-4bc7-a88d-9ad2510433ec service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b8bd3e9b-26f3-4e65-8085-1deb7d423e2e req-af46fe25-aed2-4bc7-a88d-9ad2510433ec service nova] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b8bd3e9b-26f3-4e65-8085-1deb7d423e2e req-af46fe25-aed2-4bc7-a88d-9ad2510433ec service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b8bd3e9b-26f3-4e65-8085-1deb7d423e2e req-af46fe25-aed2-4bc7-a88d-9ad2510433ec service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-b8bd3e9b-26f3-4e65-8085-1deb7d423e2e req-af46fe25-aed2-4bc7-a88d-9ad2510433ec service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] No waiting events found dispatching network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:15:19 user nova-compute[75113]: WARNING nova.compute.manager [req-b8bd3e9b-26f3-4e65-8085-1deb7d423e2e req-af46fe25-aed2-4bc7-a88d-9ad2510433ec service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received unexpected event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing inventories for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating ProviderTree inventory for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating inventory in ProviderTree for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing aggregate associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, aggregates: None {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing trait associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:15:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.812s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:20 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:15:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:15:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:15:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:15:20 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:15:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-13b540fb-750a-4a8f-a231-4ef4d58b1fcd tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:15:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Updating instance_info_cache with network_info: [{"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:15:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-eb676c87-2198-4d2a-abf4-c7df6780331b req-c5bc9d6e-1c59-4d89-99f5-5da59db61c18 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:15:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-eb676c87-2198-4d2a-abf4-c7df6780331b req-c5bc9d6e-1c59-4d89-99f5-5da59db61c18 service nova] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-eb676c87-2198-4d2a-abf4-c7df6780331b req-c5bc9d6e-1c59-4d89-99f5-5da59db61c18 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-eb676c87-2198-4d2a-abf4-c7df6780331b req-c5bc9d6e-1c59-4d89-99f5-5da59db61c18 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-eb676c87-2198-4d2a-abf4-c7df6780331b req-c5bc9d6e-1c59-4d89-99f5-5da59db61c18 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] No waiting events found dispatching network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:15:21 user nova-compute[75113]: WARNING nova.compute.manager [req-eb676c87-2198-4d2a-abf4-c7df6780331b req-c5bc9d6e-1c59-4d89-99f5-5da59db61c18 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received unexpected event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 for instance with vm_state active and task_state None.
Oct 26 17:15:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:15:21 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:15:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:15:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:15:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:15:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:15:21 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:15:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:22 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:15:22 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 17:15:22 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] There are 0 instances to clean {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 17:15:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:15:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:26 user nova-compute[75113]: INFO nova.compute.manager [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Detaching volume 90759f59-0815-4d3a-9437-c60888b23158
Oct 26 17:15:26 user nova-compute[75113]: INFO nova.virt.block_device [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Attempting to driver detach volume 90759f59-0815-4d3a-9437-c60888b23158 from mountpoint /dev/vdb
Oct 26 17:15:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Attempting to detach device vdb from instance e216e427-7231-4491-85f8-607c930e0d43 from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:15:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:15:26 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:15:26 user nova-compute[75113]:   <source dev="/dev/sde"/>
Oct 26 17:15:26 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:15:26 user nova-compute[75113]:   <serial>90759f59-0815-4d3a-9437-c60888b23158</serial>
Oct 26 17:15:26 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 17:15:26 user nova-compute[75113]: </disk>
Oct 26 17:15:26 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:15:26 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully detached device vdb from instance e216e427-7231-4491-85f8-607c930e0d43 from the persistent domain config.
Oct 26 17:15:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e216e427-7231-4491-85f8-607c930e0d43 from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:15:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:15:26 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:15:26 user nova-compute[75113]:   <source dev="/dev/sde"/>
Oct 26 17:15:26 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:15:26 user nova-compute[75113]:   <serial>90759f59-0815-4d3a-9437-c60888b23158</serial>
Oct 26 17:15:26 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 17:15:26 user nova-compute[75113]: </disk>
Oct 26 17:15:26 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:15:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:15:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:47 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e216e427-7231-4491-85f8-607c930e0d43 is timed out.
Oct 26 17:15:47 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully detached device vdb from instance e216e427-7231-4491-85f8-607c930e0d43 from the live domain config.
Oct 26 17:15:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npCXrgbf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:15:47 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e4923c-e2ad-4c94-af9d-86921eeb41e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:15:47 user nova-compute[75113]: No targets found.
Oct 26 17:15:47 user nova-compute[75113]: iSNS:
Oct 26 17:15:47 user nova-compute[75113]: No targets found.
Oct 26 17:15:47 user nova-compute[75113]: STATIC:
Oct 26 17:15:47 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143
Oct 26 17:15:47 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:15:47 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:15:47 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158
Oct 26 17:15:47 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:15:47 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:15:47 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:15:47 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:15:47 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:15:47 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf
Oct 26 17:15:47 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:15:47 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:15:47 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72
Oct 26 17:15:47 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:15:47 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:15:47 user nova-compute[75113]: FIRMWARE:
Oct 26 17:15:47 user nova-compute[75113]: No targets found.
Oct 26 17:15:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:15:47 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:15:47 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0487d8e-d861-485e-8e4f-d19409313411]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ffe5da-9821-450c-b791-ca4235360730]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:15:47 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:15:47 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:15:47 user nova-compute[75113]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:15:47 user nova-compute[75113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)
Oct 26 17:15:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:15:47 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:15:47 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:15:47 user nova-compute[75113]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 (non-flash)
Oct 26 17:15:47 user nova-compute[75113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)
Oct 26 17:15:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914235510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158'): ({'sde'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Removing single pathed devices sde {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d093faa3-35a1-42eb-a319-f67cb841d8ba]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ac4ba4-8eae-471d-8f3b-00d5193c0ef0]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Flushing IO for device /dev/sde {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc53ee5-58d6-414a-9525-ac42b2c235a5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[630dac3d-219a-4a98-897f-3d5ce496a8c7]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] SCSI volumes sde have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4015b935-9a47-4496-8825-3dffe094f44e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc897f-b2e3-4c85-a3af-21a9461fddf8]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260]
Oct 26 17:15:47 user nova-compute[75113]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158, portal: 172.16.0.220,3260] successful.
Oct 26 17:15:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90759f59-0815-4d3a-9437-c60888b23158 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ac62d4-e551-4e98-b926-d9f4c9b025d4]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] <== disconnect_volume: return (307ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:15:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:15:48 user nova-compute[75113]: DEBUG nova.objects.instance [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'flavor' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:15:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-90ccbf84-680e-44de-b816-024a20093f14 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.904s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3926d2ac-6531-4f70-a6f2-3f942f8f87d1 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3926d2ac-6531-4f70-a6f2-3f942f8f87d1 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3926d2ac-6531-4f70-a6f2-3f942f8f87d1 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3926d2ac-6531-4f70-a6f2-3f942f8f87d1 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75113) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG nova.objects.instance [None req-3926d2ac-6531-4f70-a6f2-3f942f8f87d1 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'flavor' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-22223eca-09f5-4bfd-9b59-28fcf045aa33 req-11b07d77-5c60-400b-86f3-87f9fc06e774 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-unplugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-22223eca-09f5-4bfd-9b59-28fcf045aa33 req-11b07d77-5c60-400b-86f3-87f9fc06e774 service nova] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-22223eca-09f5-4bfd-9b59-28fcf045aa33 req-11b07d77-5c60-400b-86f3-87f9fc06e774 service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-22223eca-09f5-4bfd-9b59-28fcf045aa33 req-11b07d77-5c60-400b-86f3-87f9fc06e774 service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-22223eca-09f5-4bfd-9b59-28fcf045aa33 req-11b07d77-5c60-400b-86f3-87f9fc06e774 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] No waiting events found dispatching network-vif-unplugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:15:49 user nova-compute[75113]: WARNING nova.compute.manager [req-22223eca-09f5-4bfd-9b59-28fcf045aa33 req-11b07d77-5c60-400b-86f3-87f9fc06e774 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received unexpected event network-vif-unplugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 for instance with vm_state active and task_state powering-off.
Oct 26 17:15:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:50 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: e216e427-7231-4491-85f8-607c930e0d43] Instance destroyed successfully.
Oct 26 17:15:50 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3926d2ac-6531-4f70-a6f2-3f942f8f87d1 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:15:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3926d2ac-6531-4f70-a6f2-3f942f8f87d1 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.879s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-c2382e61-a259-4822-84ff-8d9ce7fd457e req-4321d914-356a-48a4-97d9-4bf0de194dcf service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:15:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c2382e61-a259-4822-84ff-8d9ce7fd457e req-4321d914-356a-48a4-97d9-4bf0de194dcf service nova] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c2382e61-a259-4822-84ff-8d9ce7fd457e req-4321d914-356a-48a4-97d9-4bf0de194dcf service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c2382e61-a259-4822-84ff-8d9ce7fd457e req-4321d914-356a-48a4-97d9-4bf0de194dcf service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-c2382e61-a259-4822-84ff-8d9ce7fd457e req-4321d914-356a-48a4-97d9-4bf0de194dcf service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] No waiting events found dispatching network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:15:51 user nova-compute[75113]: WARNING nova.compute.manager [req-c2382e61-a259-4822-84ff-8d9ce7fd457e req-4321d914-356a-48a4-97d9-4bf0de194dcf service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received unexpected event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 for instance with vm_state stopped and task_state None.
Oct 26 17:15:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:53 user nova-compute[75113]: INFO nova.compute.manager [None req-a2b40cc5-f028-4060-8b75-a8e9f858bf16 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Unrescuing
Oct 26 17:15:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a2b40cc5-f028-4060-8b75-a8e9f858bf16 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:15:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a2b40cc5-f028-4060-8b75-a8e9f858bf16 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquired lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:15:53 user nova-compute[75113]: DEBUG nova.network.neutron [None req-a2b40cc5-f028-4060-8b75-a8e9f858bf16 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:15:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:54 user nova-compute[75113]: DEBUG nova.network.neutron [None req-a2b40cc5-f028-4060-8b75-a8e9f858bf16 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updating instance_info_cache with network_info: [{"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:15:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a2b40cc5-f028-4060-8b75-a8e9f858bf16 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Releasing lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:15:54 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a2b40cc5-f028-4060-8b75-a8e9f858bf16 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'flavor' on Instance uuid 296a09d4-ed82-4876-9fbd-baadff6a7b4d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:15:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-4074b8a6-7e6a-4fc0-a49e-1fd1834c4c69 req-c071a1c8-6c6c-4936-86da-b4d6389b5b01 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-unplugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:15:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4074b8a6-7e6a-4fc0-a49e-1fd1834c4c69 req-c071a1c8-6c6c-4936-86da-b4d6389b5b01 service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4074b8a6-7e6a-4fc0-a49e-1fd1834c4c69 req-c071a1c8-6c6c-4936-86da-b4d6389b5b01 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4074b8a6-7e6a-4fc0-a49e-1fd1834c4c69 req-c071a1c8-6c6c-4936-86da-b4d6389b5b01 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-4074b8a6-7e6a-4fc0-a49e-1fd1834c4c69 req-c071a1c8-6c6c-4936-86da-b4d6389b5b01 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-unplugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:15:54 user nova-compute[75113]: WARNING nova.compute.manager [req-4074b8a6-7e6a-4fc0-a49e-1fd1834c4c69 req-c071a1c8-6c6c-4936-86da-b4d6389b5b01 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-unplugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:15:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:55 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Instance destroyed successfully.
Oct 26 17:15:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-8548f5db-6d75-4afe-be32-2352462603c2 req-bafbf8e6-e14a-4701-8678-7f2e0d0e842d service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:15:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8548f5db-6d75-4afe-be32-2352462603c2 req-bafbf8e6-e14a-4701-8678-7f2e0d0e842d service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8548f5db-6d75-4afe-be32-2352462603c2 req-bafbf8e6-e14a-4701-8678-7f2e0d0e842d service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8548f5db-6d75-4afe-be32-2352462603c2 req-bafbf8e6-e14a-4701-8678-7f2e0d0e842d service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-8548f5db-6d75-4afe-be32-2352462603c2 req-bafbf8e6-e14a-4701-8678-7f2e0d0e842d service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:15:57 user nova-compute[75113]: WARNING nova.compute.manager [req-8548f5db-6d75-4afe-be32-2352462603c2 req-bafbf8e6-e14a-4701-8678-7f2e0d0e842d service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:15:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-8548f5db-6d75-4afe-be32-2352462603c2 req-bafbf8e6-e14a-4701-8678-7f2e0d0e842d service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:15:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8548f5db-6d75-4afe-be32-2352462603c2 req-bafbf8e6-e14a-4701-8678-7f2e0d0e842d service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8548f5db-6d75-4afe-be32-2352462603c2 req-bafbf8e6-e14a-4701-8678-7f2e0d0e842d service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8548f5db-6d75-4afe-be32-2352462603c2 req-bafbf8e6-e14a-4701-8678-7f2e0d0e842d service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-8548f5db-6d75-4afe-be32-2352462603c2 req-bafbf8e6-e14a-4701-8678-7f2e0d0e842d service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:15:57 user nova-compute[75113]: WARNING nova.compute.manager [req-8548f5db-6d75-4afe-be32-2352462603c2 req-bafbf8e6-e14a-4701-8678-7f2e0d0e842d service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:15:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:15:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-55b43399-ca12-4939-9bde-fcb6c9b761ea req-5dc77fe4-173d-45bb-968c-39a16d58f092 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:15:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55b43399-ca12-4939-9bde-fcb6c9b761ea req-5dc77fe4-173d-45bb-968c-39a16d58f092 service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:15:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55b43399-ca12-4939-9bde-fcb6c9b761ea req-5dc77fe4-173d-45bb-968c-39a16d58f092 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:15:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55b43399-ca12-4939-9bde-fcb6c9b761ea req-5dc77fe4-173d-45bb-968c-39a16d58f092 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:15:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-55b43399-ca12-4939-9bde-fcb6c9b761ea req-5dc77fe4-173d-45bb-968c-39a16d58f092 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:15:59 user nova-compute[75113]: WARNING nova.compute.manager [req-55b43399-ca12-4939-9bde-fcb6c9b761ea req-5dc77fe4-173d-45bb-968c-39a16d58f092 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state rescued and task_state unrescuing.
Oct 26 17:15:59 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a2b40cc5-f028-4060-8b75-a8e9f858bf16 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:16:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:16:10 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:16:11 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:16:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:16:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:16:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:16:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:16:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:14 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:16:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:16:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:16:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:16:14 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:16:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:16:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:16:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:16 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:16:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:16:18 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:16:18 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7916MB free_disk=24.929813385009766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 7cbb27a2-37c5-4045-a005-719f79f30714 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e216e427-7231-4491-85f8-607c930e0d43 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 60b00b94-8e37-489a-a061-7cd123289b5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 644032e4-b692-4608-9fd2-f1c609fd766d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:16:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:20 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:16:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:16:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:16:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:16:20 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:16:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Updating instance_info_cache with network_info: [{"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:16:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:16:21 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:16:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:16:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:16:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:16:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:16:21 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:16:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:16:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:30 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:16:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:44 user nova-compute[75113]: INFO nova.compute.manager [None req-92886603-a01f-4741-9e73-6a688d2bc41e tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Get console output
Oct 26 17:16:44 user nova-compute[75113]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 26 17:16:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Acquiring lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:16:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:16:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:16:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:16:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:16:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:16:47 user nova-compute[75113]: INFO nova.compute.claims [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Claim successful on node user
Oct 26 17:16:48 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:16:48 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:16:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG nova.policy [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6aad9d7f0c664d3fb0bfccbe33f931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c232b5ce547b18483b295e460c475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:16:48 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Creating image(s)
Oct 26 17:16:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "/opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "/opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.188s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.234s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk 1073741824" returned: 0 in 0.066s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Successfully created port: 836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Cannot resize image /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Ensure instance console log exists: /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Successfully updated port: 836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Acquiring lock "refresh_cache-8ef579e4-167c-42cf-bd7a-65d9862f5023" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Acquired lock "refresh_cache-8ef579e4-167c-42cf-bd7a-65d9862f5023" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-2c557545-60f1-42be-a463-6828dd478746 req-3f3c6f0c-1e2a-4c49-8a95-0986f9b9434d service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Received event network-changed-836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-2c557545-60f1-42be-a463-6828dd478746 req-3f3c6f0c-1e2a-4c49-8a95-0986f9b9434d service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Refreshing instance network info cache due to event network-changed-836188fa-7993-45db-b0e8-4fc2209a9785. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2c557545-60f1-42be-a463-6828dd478746 req-3f3c6f0c-1e2a-4c49-8a95-0986f9b9434d service nova] Acquiring lock "refresh_cache-8ef579e4-167c-42cf-bd7a-65d9862f5023" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:16:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Updating instance_info_cache with network_info: [{"id": "836188fa-7993-45db-b0e8-4fc2209a9785", "address": "fa:16:3e:14:57:0d", "network": {"id": "5ae68db4-1ba4-4cfb-8ce2-164950042964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1147509509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5c232b5ce547b18483b295e460c475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836188fa-79", "ovs_interfaceid": "836188fa-7993-45db-b0e8-4fc2209a9785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Releasing lock "refresh_cache-8ef579e4-167c-42cf-bd7a-65d9862f5023" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Instance network_info: |[{"id": "836188fa-7993-45db-b0e8-4fc2209a9785", "address": "fa:16:3e:14:57:0d", "network": {"id": "5ae68db4-1ba4-4cfb-8ce2-164950042964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1147509509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5c232b5ce547b18483b295e460c475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836188fa-79", "ovs_interfaceid": "836188fa-7993-45db-b0e8-4fc2209a9785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2c557545-60f1-42be-a463-6828dd478746 req-3f3c6f0c-1e2a-4c49-8a95-0986f9b9434d service nova] Acquired lock "refresh_cache-8ef579e4-167c-42cf-bd7a-65d9862f5023" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.network.neutron [req-2c557545-60f1-42be-a463-6828dd478746 req-3f3c6f0c-1e2a-4c49-8a95-0986f9b9434d service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Refreshing network info cache for port 836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Start _get_guest_xml network_info=[{"id": "836188fa-7993-45db-b0e8-4fc2209a9785", "address": "fa:16:3e:14:57:0d", "network": {"id": "5ae68db4-1ba4-4cfb-8ce2-164950042964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1147509509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5c232b5ce547b18483b295e460c475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836188fa-79", "ovs_interfaceid": "836188fa-7993-45db-b0e8-4fc2209a9785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:16:50 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:16:50 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2065846528',display_name='tempest-TestServerVolumeAttachmentScenario-server-2065846528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2065846528',id=35,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqLOv2dKzncAwePesQ4yoiihPNvEeXEmJLfrGoUCADqAmjRd305PbTwQz+4BpO19/XU8MGP1cVq6e7FmamMjWPcTStg2SvVC+UTE/8LWokAyk98R9Pm4Y4OEFKRVr7iWQ==',key_name='tempest-keypair-964175039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a5c232b5ce547b18483b295e460c475',ramdisk_id='',reservation_id='r-jc950jrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1127476989',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1127476989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aad9d7f0c664d3fb0bfccbe33f931f6',uuid=8ef579e4-167c-42cf-bd7a-65d9862f5023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "836188fa-7993-45db-b0e8-4fc2209a9785", "address": "fa:16:3e:14:57:0d", "network": {"id": "5ae68db4-1ba4-4cfb-8ce2-164950042964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1147509509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5c232b5ce547b18483b295e460c475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836188fa-79", "ovs_interfaceid": "836188fa-7993-45db-b0e8-4fc2209a9785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Converting VIF {"id": "836188fa-7993-45db-b0e8-4fc2209a9785", "address": "fa:16:3e:14:57:0d", "network": {"id": "5ae68db4-1ba4-4cfb-8ce2-164950042964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1147509509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5c232b5ce547b18483b295e460c475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836188fa-79", "ovs_interfaceid": "836188fa-7993-45db-b0e8-4fc2209a9785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:57:0d,bridge_name='br-int',has_traffic_filtering=True,id=836188fa-7993-45db-b0e8-4fc2209a9785,network=Network(5ae68db4-1ba4-4cfb-8ce2-164950042964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836188fa-79') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ef579e4-167c-42cf-bd7a-65d9862f5023 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:16:50 user nova-compute[75113]:   <uuid>8ef579e4-167c-42cf-bd7a-65d9862f5023</uuid>
Oct 26 17:16:50 user nova-compute[75113]:   <name>instance-00000023</name>
Oct 26 17:16:50 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:16:50 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:16:50 user nova-compute[75113]:   <metadata>
Oct 26 17:16:50 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:16:50 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:16:50 user nova-compute[75113]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2065846528</nova:name>
Oct 26 17:16:50 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:16:50</nova:creationTime>
Oct 26 17:16:50 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:16:50 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:16:50 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:16:50 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:16:50 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:16:50 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:16:50 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:16:50 user nova-compute[75113]:       <nova:owner>
Oct 26 17:16:50 user nova-compute[75113]:         <nova:user uuid="6aad9d7f0c664d3fb0bfccbe33f931f6">tempest-TestServerVolumeAttachmentScenario-1127476989-project-member</nova:user>
Oct 26 17:16:50 user nova-compute[75113]:         <nova:project uuid="8a5c232b5ce547b18483b295e460c475">tempest-TestServerVolumeAttachmentScenario-1127476989</nova:project>
Oct 26 17:16:50 user nova-compute[75113]:       </nova:owner>
Oct 26 17:16:50 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:16:50 user nova-compute[75113]:       <nova:ports>
Oct 26 17:16:50 user nova-compute[75113]:         <nova:port uuid="836188fa-7993-45db-b0e8-4fc2209a9785">
Oct 26 17:16:50 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 17:16:50 user nova-compute[75113]:         </nova:port>
Oct 26 17:16:50 user nova-compute[75113]:       </nova:ports>
Oct 26 17:16:50 user nova-compute[75113]:     </nova:instance>
Oct 26 17:16:50 user nova-compute[75113]:   </metadata>
Oct 26 17:16:50 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:16:50 user nova-compute[75113]:     <system>
Oct 26 17:16:50 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:16:50 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:16:50 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:16:50 user nova-compute[75113]:       <entry name="serial">8ef579e4-167c-42cf-bd7a-65d9862f5023</entry>
Oct 26 17:16:50 user nova-compute[75113]:       <entry name="uuid">8ef579e4-167c-42cf-bd7a-65d9862f5023</entry>
Oct 26 17:16:50 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:16:50 user nova-compute[75113]:     </system>
Oct 26 17:16:50 user nova-compute[75113]:   </sysinfo>
Oct 26 17:16:50 user nova-compute[75113]:   <os>
Oct 26 17:16:50 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:16:50 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:16:50 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:16:50 user nova-compute[75113]:   </os>
Oct 26 17:16:50 user nova-compute[75113]:   <features>
Oct 26 17:16:50 user nova-compute[75113]:     <acpi/>
Oct 26 17:16:50 user nova-compute[75113]:     <apic/>
Oct 26 17:16:50 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:16:50 user nova-compute[75113]:   </features>
Oct 26 17:16:50 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:16:50 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:16:50 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:16:50 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:16:50 user nova-compute[75113]:   </clock>
Oct 26 17:16:50 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:16:50 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:16:50 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:16:50 user nova-compute[75113]:   </cpu>
Oct 26 17:16:50 user nova-compute[75113]:   <devices>
Oct 26 17:16:50 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:16:50 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:16:50 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk"/>
Oct 26 17:16:50 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:16:50 user nova-compute[75113]:     </disk>
Oct 26 17:16:50 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:16:50 user nova-compute[75113]:       <mac address="fa:16:3e:14:57:0d"/>
Oct 26 17:16:50 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:16:50 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:16:50 user nova-compute[75113]:       <target dev="tap836188fa-79"/>
Oct 26 17:16:50 user nova-compute[75113]:     </interface>
Oct 26 17:16:50 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:16:50 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/console.log" append="off"/>
Oct 26 17:16:50 user nova-compute[75113]:     </serial>
Oct 26 17:16:50 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:16:50 user nova-compute[75113]:     <video>
Oct 26 17:16:50 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:16:50 user nova-compute[75113]:     </video>
Oct 26 17:16:50 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:16:50 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:16:50 user nova-compute[75113]:     </rng>
Oct 26 17:16:50 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:16:50 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:16:50 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:16:50 user nova-compute[75113]:     </memballoon>
Oct 26 17:16:50 user nova-compute[75113]:   </devices>
Oct 26 17:16:50 user nova-compute[75113]: </domain>
Oct 26 17:16:50 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2065846528',display_name='tempest-TestServerVolumeAttachmentScenario-server-2065846528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2065846528',id=35,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqLOv2dKzncAwePesQ4yoiihPNvEeXEmJLfrGoUCADqAmjRd305PbTwQz+4BpO19/XU8MGP1cVq6e7FmamMjWPcTStg2SvVC+UTE/8LWokAyk98R9Pm4Y4OEFKRVr7iWQ==',key_name='tempest-keypair-964175039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a5c232b5ce547b18483b295e460c475',ramdisk_id='',reservation_id='r-jc950jrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1127476989',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1127476989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aad9d7f0c664d3fb0bfccbe33f931f6',uuid=8ef579e4-167c-42cf-bd7a-65d9862f5023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "836188fa-7993-45db-b0e8-4fc2209a9785", "address": "fa:16:3e:14:57:0d", "network": {"id": "5ae68db4-1ba4-4cfb-8ce2-164950042964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1147509509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5c232b5ce547b18483b295e460c475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836188fa-79", "ovs_interfaceid": "836188fa-7993-45db-b0e8-4fc2209a9785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Converting VIF {"id": "836188fa-7993-45db-b0e8-4fc2209a9785", "address": "fa:16:3e:14:57:0d", "network": {"id": "5ae68db4-1ba4-4cfb-8ce2-164950042964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1147509509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5c232b5ce547b18483b295e460c475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836188fa-79", "ovs_interfaceid": "836188fa-7993-45db-b0e8-4fc2209a9785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:57:0d,bridge_name='br-int',has_traffic_filtering=True,id=836188fa-7993-45db-b0e8-4fc2209a9785,network=Network(5ae68db4-1ba4-4cfb-8ce2-164950042964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836188fa-79') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG os_vif [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:57:0d,bridge_name='br-int',has_traffic_filtering=True,id=836188fa-7993-45db-b0e8-4fc2209a9785,network=Network(5ae68db4-1ba4-4cfb-8ce2-164950042964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836188fa-79') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ca1e500-ca6b-547f-8ba8-d317a3545a86', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap836188fa-79, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap836188fa-79, col_values=(('qos', UUID('c0e4e9fd-48cb-4425-9bb0-878b8dd6759d')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap836188fa-79, col_values=(('external_ids', {'iface-id': '836188fa-7993-45db-b0e8-4fc2209a9785', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:57:0d', 'vm-uuid': '8ef579e4-167c-42cf-bd7a-65d9862f5023'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:50 user nova-compute[75113]: INFO os_vif [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:57:0d,bridge_name='br-int',has_traffic_filtering=True,id=836188fa-7993-45db-b0e8-4fc2209a9785,network=Network(5ae68db4-1ba4-4cfb-8ce2-164950042964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836188fa-79')
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] No VIF found with MAC fa:16:3e:14:57:0d, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.network.neutron [req-2c557545-60f1-42be-a463-6828dd478746 req-3f3c6f0c-1e2a-4c49-8a95-0986f9b9434d service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Updated VIF entry in instance network info cache for port 836188fa-7993-45db-b0e8-4fc2209a9785. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG nova.network.neutron [req-2c557545-60f1-42be-a463-6828dd478746 req-3f3c6f0c-1e2a-4c49-8a95-0986f9b9434d service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Updating instance_info_cache with network_info: [{"id": "836188fa-7993-45db-b0e8-4fc2209a9785", "address": "fa:16:3e:14:57:0d", "network": {"id": "5ae68db4-1ba4-4cfb-8ce2-164950042964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1147509509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5c232b5ce547b18483b295e460c475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836188fa-79", "ovs_interfaceid": "836188fa-7993-45db-b0e8-4fc2209a9785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:16:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2c557545-60f1-42be-a463-6828dd478746 req-3f3c6f0c-1e2a-4c49-8a95-0986f9b9434d service nova] Releasing lock "refresh_cache-8ef579e4-167c-42cf-bd7a-65d9862f5023" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:16:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-3fafddf9-4eb5-4e4b-996d-d9eb8d66ad95 req-0c49130c-a8d4-42da-9566-8e3245e9aa1f service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Received event network-vif-plugged-836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:16:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3fafddf9-4eb5-4e4b-996d-d9eb8d66ad95 req-0c49130c-a8d4-42da-9566-8e3245e9aa1f service nova] Acquiring lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:16:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3fafddf9-4eb5-4e4b-996d-d9eb8d66ad95 req-0c49130c-a8d4-42da-9566-8e3245e9aa1f service nova] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:16:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3fafddf9-4eb5-4e4b-996d-d9eb8d66ad95 req-0c49130c-a8d4-42da-9566-8e3245e9aa1f service nova] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:16:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-3fafddf9-4eb5-4e4b-996d-d9eb8d66ad95 req-0c49130c-a8d4-42da-9566-8e3245e9aa1f service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] No waiting events found dispatching network-vif-plugged-836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:16:51 user nova-compute[75113]: WARNING nova.compute.manager [req-3fafddf9-4eb5-4e4b-996d-d9eb8d66ad95 req-0c49130c-a8d4-42da-9566-8e3245e9aa1f service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Received unexpected event network-vif-plugged-836188fa-7993-45db-b0e8-4fc2209a9785 for instance with vm_state building and task_state spawning.
Oct 26 17:16:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:16:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:16:53 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Instance spawned successfully.
Oct 26 17:16:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:16:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:16:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:16:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:16:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:16:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:16:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:16:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-4b78922d-0f3f-4ce0-9f13-327116835e2f req-05d850de-a4eb-4296-9d16-f65291cad055 service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Received event network-vif-plugged-836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:16:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4b78922d-0f3f-4ce0-9f13-327116835e2f req-05d850de-a4eb-4296-9d16-f65291cad055 service nova] Acquiring lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:16:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4b78922d-0f3f-4ce0-9f13-327116835e2f req-05d850de-a4eb-4296-9d16-f65291cad055 service nova] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:16:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4b78922d-0f3f-4ce0-9f13-327116835e2f req-05d850de-a4eb-4296-9d16-f65291cad055 service nova] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:16:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-4b78922d-0f3f-4ce0-9f13-327116835e2f req-05d850de-a4eb-4296-9d16-f65291cad055 service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] No waiting events found dispatching network-vif-plugged-836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:16:54 user nova-compute[75113]: WARNING nova.compute.manager [req-4b78922d-0f3f-4ce0-9f13-327116835e2f req-05d850de-a4eb-4296-9d16-f65291cad055 service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Received unexpected event network-vif-plugged-836188fa-7993-45db-b0e8-4fc2209a9785 for instance with vm_state building and task_state spawning.
Oct 26 17:16:54 user nova-compute[75113]: INFO nova.compute.manager [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Took 5.55 seconds to spawn the instance on the hypervisor.
Oct 26 17:16:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:16:54 user nova-compute[75113]: INFO nova.compute.manager [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Took 6.33 seconds to build instance.
Oct 26 17:16:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a3e8f4f-c9f3-4f8a-9882-6aa0f740d9a1 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.455s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:16:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:16:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "60b00b94-8e37-489a-a061-7cd123289b5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:07 user nova-compute[75113]: INFO nova.compute.manager [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Terminating instance
Oct 26 17:17:07 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-b60b17cf-b31b-4868-9f83-84a6c3932277 req-e442d638-094b-42ea-98f4-aab868dc9021 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-unplugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b60b17cf-b31b-4868-9f83-84a6c3932277 req-e442d638-094b-42ea-98f4-aab868dc9021 service nova] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b60b17cf-b31b-4868-9f83-84a6c3932277 req-e442d638-094b-42ea-98f4-aab868dc9021 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b60b17cf-b31b-4868-9f83-84a6c3932277 req-e442d638-094b-42ea-98f4-aab868dc9021 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-b60b17cf-b31b-4868-9f83-84a6c3932277 req-e442d638-094b-42ea-98f4-aab868dc9021 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] No waiting events found dispatching network-vif-unplugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG nova.compute.manager [req-b60b17cf-b31b-4868-9f83-84a6c3932277 req-e442d638-094b-42ea-98f4-aab868dc9021 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-unplugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:17:07 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Instance destroyed successfully.
Oct 26 17:17:07 user nova-compute[75113]: DEBUG nova.objects.instance [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'resources' on Instance uuid 60b00b94-8e37-489a-a061-7cd123289b5d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:10:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-434832296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-434832296',id=31,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:13:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-k69bz2e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:15:21Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=60b00b94-8e37-489a-a061-7cd123289b5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "address": "fa:16:3e:b3:78:d7", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff9cdd9-d8", "ovs_interfaceid": "4ff9cdd9-d82f-4214-a51a-73c52e25ab65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:78:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ff9cdd9-d82f-4214-a51a-73c52e25ab65,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff9cdd9-d8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG os_vif [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:78:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ff9cdd9-d82f-4214-a51a-73c52e25ab65,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff9cdd9-d8') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ff9cdd9-d8, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=468e4048-31b7-42f6-84e8-0c72fdb41ada) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:07 user nova-compute[75113]: INFO os_vif [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:78:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ff9cdd9-d82f-4214-a51a-73c52e25ab65,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff9cdd9-d8')
Oct 26 17:17:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqoTPlth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:17:07 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:17:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7448bab2-6983-4db7-97fb-eb7ac347964d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:17:07 user nova-compute[75113]: No targets found.
Oct 26 17:17:07 user nova-compute[75113]: iSNS:
Oct 26 17:17:07 user nova-compute[75113]: No targets found.
Oct 26 17:17:07 user nova-compute[75113]: STATIC:
Oct 26 17:17:07 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143
Oct 26 17:17:07 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:17:07 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:17:07 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:17:07 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:17:07 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:17:07 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf
Oct 26 17:17:07 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:17:07 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:17:07 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72
Oct 26 17:17:07 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:17:07 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:17:07 user nova-compute[75113]: FIRMWARE:
Oct 26 17:17:07 user nova-compute[75113]: No targets found.
Oct 26 17:17:07 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:17:07 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:17:07 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:17:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[de39deb4-37c1-470c-adf7-d68bd2a4fa83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[120a2746-c663-4b22-a658-2fad76bae106]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:17:08 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:17:08 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:17:08 user nova-compute[75113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)
Oct 26 17:17:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:17:08 user nova-compute[75113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 (non-flash)
Oct 26 17:17:08 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:17:08 user nova-compute[75113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)
Oct 26 17:17:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914288040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e206a8e-1593-4a8d-8104-38476578d0e5]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a113a5b5-b918-472f-9f83-4aea0ef56c11]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0347d5-804f-4831-a53e-e69597b4772e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be031e4-083b-4274-9414-97a655cce776]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26535346437393037', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_27b99bb9', '/dev/disk/by-id/scsi-1SCST_BIO27b99bb9-e54d790796a74efc') {{(pid=86603) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 17:17:08 user nova-compute[75113]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26535346437393037
Oct 26 17:17:08 user nova-compute[75113]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_27b99bb9
Oct 26 17:17:08 user nova-compute[75113]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO27b99bb9-e54d790796a74efc
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0b4f82-e8c1-4eef-900f-da48eea44610]: (4, None) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1aea48-233d-4adc-a8bf-482a98f3b066]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[699a316b-8276-49b2-8480-640b786767b3]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143, portal: 172.16.0.220,3260]
Oct 26 17:17:08 user nova-compute[75113]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143, portal: 172.16.0.220,3260] successful.
Oct 26 17:17:08 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feedeeb4-1371-440a-93f0-d1f973499143 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e969a5db-101d-4904-958d-ef026bf6bc6c]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] <== disconnect_volume: return (338ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:17:08 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Deleting instance files /opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d_del
Oct 26 17:17:08 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Deletion of /opt/stack/data/nova/instances/60b00b94-8e37-489a-a061-7cd123289b5d_del complete
Oct 26 17:17:08 user nova-compute[75113]: INFO nova.compute.manager [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 26 17:17:08 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:17:08 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:17:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-9e00f872-d851-4844-b177-480f4cb6aa3b req-a36b6e5e-127e-48bc-86a4-d41f2be60ff9 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-deleted-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:09 user nova-compute[75113]: INFO nova.compute.manager [req-9e00f872-d851-4844-b177-480f4cb6aa3b req-a36b6e5e-127e-48bc-86a4-d41f2be60ff9 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Neutron deleted interface 4ff9cdd9-d82f-4214-a51a-73c52e25ab65; detaching it from the instance and deleting it from the info cache
Oct 26 17:17:09 user nova-compute[75113]: DEBUG nova.network.neutron [req-9e00f872-d851-4844-b177-480f4cb6aa3b req-a36b6e5e-127e-48bc-86a4-d41f2be60ff9 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:17:09 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Took 0.65 seconds to deallocate network for instance.
Oct 26 17:17:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-9e00f872-d851-4844-b177-480f4cb6aa3b req-a36b6e5e-127e-48bc-86a4-d41f2be60ff9 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Detach interface failed, port_id=4ff9cdd9-d82f-4214-a51a-73c52e25ab65, reason: Instance 60b00b94-8e37-489a-a061-7cd123289b5d could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:17:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-87e061ba-7564-410d-8d56-f93a9578c0ea req-94306437-ecf9-4c20-a924-dc403cf9b331 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-87e061ba-7564-410d-8d56-f93a9578c0ea req-94306437-ecf9-4c20-a924-dc403cf9b331 service nova] Acquiring lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-87e061ba-7564-410d-8d56-f93a9578c0ea req-94306437-ecf9-4c20-a924-dc403cf9b331 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-87e061ba-7564-410d-8d56-f93a9578c0ea req-94306437-ecf9-4c20-a924-dc403cf9b331 service nova] Lock "60b00b94-8e37-489a-a061-7cd123289b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:09 user nova-compute[75113]: DEBUG nova.compute.manager [req-87e061ba-7564-410d-8d56-f93a9578c0ea req-94306437-ecf9-4c20-a924-dc403cf9b331 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] No waiting events found dispatching network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:17:09 user nova-compute[75113]: WARNING nova.compute.manager [req-87e061ba-7564-410d-8d56-f93a9578c0ea req-94306437-ecf9-4c20-a924-dc403cf9b331 service nova] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Received unexpected event network-vif-plugged-4ff9cdd9-d82f-4214-a51a-73c52e25ab65 for instance with vm_state active and task_state deleting.
Oct 26 17:17:10 user nova-compute[75113]: INFO nova.compute.manager [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 60b00b94-8e37-489a-a061-7cd123289b5d] Took 1.18 seconds to detach 1 volumes for instance.
Oct 26 17:17:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:10 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:17:10 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:17:10 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:17:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:10 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Deleted allocations for instance 60b00b94-8e37-489a-a061-7cd123289b5d
Oct 26 17:17:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5b21937e-999c-43a7-a35e-d293cd34c9d6 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "60b00b94-8e37-489a-a061-7cd123289b5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.676s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:13 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:17:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:14 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:17:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:14 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:17:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:17:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:17:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:17:18 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:17:18 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7920MB free_disk=24.891036987304688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 7cbb27a2-37c5-4045-a005-719f79f30714 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e216e427-7231-4491-85f8-607c930e0d43 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 644032e4-b692-4608-9fd2-f1c609fd766d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 8ef579e4-167c-42cf-bd7a-65d9862f5023 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:18 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:17:19 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:17:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:17:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Updating instance_info_cache with network_info: [{"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:17:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:17:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:24 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:17:24 user nova-compute[75113]: INFO nova.compute.claims [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Claim successful on node user
Oct 26 17:17:24 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:17:24 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:17:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:17:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:17:24 user nova-compute[75113]: DEBUG nova.network.neutron [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:17:24 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:17:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:17:24 user nova-compute[75113]: DEBUG nova.policy [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf60300c4d874a99a5a99bef82641993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d413c67bd3476cbfeb8e39af59e9ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:17:25 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Creating image(s)
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "/opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "/opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.170s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.190s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk 1073741824" returned: 0 in 0.047s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG nova.network.neutron [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Successfully created port: 9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:17:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Cannot resize image /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Ensure instance console log exists: /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.network.neutron [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Successfully updated port: 9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquired lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.network.neutron [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-9ef123f3-3c8f-48dd-a743-ec3e8014ddfe req-d1417509-f599-4c98-928a-1b4eb11ee903 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Received event network-changed-9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-9ef123f3-3c8f-48dd-a743-ec3e8014ddfe req-d1417509-f599-4c98-928a-1b4eb11ee903 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Refreshing instance network info cache due to event network-changed-9c8d391d-ef18-4deb-9312-f9667d6362ea. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9ef123f3-3c8f-48dd-a743-ec3e8014ddfe req-d1417509-f599-4c98-928a-1b4eb11ee903 service nova] Acquiring lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.network.neutron [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.network.neutron [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updating instance_info_cache with network_info: [{"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Releasing lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Instance network_info: |[{"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9ef123f3-3c8f-48dd-a743-ec3e8014ddfe req-d1417509-f599-4c98-928a-1b4eb11ee903 service nova] Acquired lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.network.neutron [req-9ef123f3-3c8f-48dd-a743-ec3e8014ddfe req-d1417509-f599-4c98-928a-1b4eb11ee903 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Refreshing network info cache for port 9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Start _get_guest_xml network_info=[{"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:17:26 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:17:26 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-863488592',display_name='tempest-TestStampPattern-server-863488592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-863488592',id=36,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWHyhdWG4vODww4J36tjcUt2ICXtezA7tiJccfBwgDPh+GMN+tQKBdFq+33nqzyfrbTLq8kX7WTafkfAiBXerZ2BCl1jBxwv1h0P5P+b6z5qmRWoytp+RGBDhwGCxEyfQ==',key_name='tempest-TestStampPattern-754663238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95d413c67bd3476cbfeb8e39af59e9ee',ramdisk_id='',reservation_id='r-jx3aex1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1797568490',owner_user_name='tempest-TestStampPattern-1797568490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:17:25Z,user_data=None,user_id='cf60300c4d874a99a5a99bef82641993',uuid=fc80403d-8fbd-4836-8d01-89fa7aad8d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Converting VIF {"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:37:33,bridge_name='br-int',has_traffic_filtering=True,id=9c8d391d-ef18-4deb-9312-f9667d6362ea,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8d391d-ef') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.objects.instance [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lazy-loading 'pci_devices' on Instance uuid fc80403d-8fbd-4836-8d01-89fa7aad8d7e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:17:26 user nova-compute[75113]:   <uuid>fc80403d-8fbd-4836-8d01-89fa7aad8d7e</uuid>
Oct 26 17:17:26 user nova-compute[75113]:   <name>instance-00000024</name>
Oct 26 17:17:26 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:17:26 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:17:26 user nova-compute[75113]:   <metadata>
Oct 26 17:17:26 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:17:26 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:17:26 user nova-compute[75113]:       <nova:name>tempest-TestStampPattern-server-863488592</nova:name>
Oct 26 17:17:26 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:17:26</nova:creationTime>
Oct 26 17:17:26 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:17:26 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:17:26 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:17:26 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:17:26 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:17:26 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:17:26 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:17:26 user nova-compute[75113]:       <nova:owner>
Oct 26 17:17:26 user nova-compute[75113]:         <nova:user uuid="cf60300c4d874a99a5a99bef82641993">tempest-TestStampPattern-1797568490-project-member</nova:user>
Oct 26 17:17:26 user nova-compute[75113]:         <nova:project uuid="95d413c67bd3476cbfeb8e39af59e9ee">tempest-TestStampPattern-1797568490</nova:project>
Oct 26 17:17:26 user nova-compute[75113]:       </nova:owner>
Oct 26 17:17:26 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:17:26 user nova-compute[75113]:       <nova:ports>
Oct 26 17:17:26 user nova-compute[75113]:         <nova:port uuid="9c8d391d-ef18-4deb-9312-f9667d6362ea">
Oct 26 17:17:26 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 17:17:26 user nova-compute[75113]:         </nova:port>
Oct 26 17:17:26 user nova-compute[75113]:       </nova:ports>
Oct 26 17:17:26 user nova-compute[75113]:     </nova:instance>
Oct 26 17:17:26 user nova-compute[75113]:   </metadata>
Oct 26 17:17:26 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:17:26 user nova-compute[75113]:     <system>
Oct 26 17:17:26 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:17:26 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:17:26 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:17:26 user nova-compute[75113]:       <entry name="serial">fc80403d-8fbd-4836-8d01-89fa7aad8d7e</entry>
Oct 26 17:17:26 user nova-compute[75113]:       <entry name="uuid">fc80403d-8fbd-4836-8d01-89fa7aad8d7e</entry>
Oct 26 17:17:26 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:17:26 user nova-compute[75113]:     </system>
Oct 26 17:17:26 user nova-compute[75113]:   </sysinfo>
Oct 26 17:17:26 user nova-compute[75113]:   <os>
Oct 26 17:17:26 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:17:26 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:17:26 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:17:26 user nova-compute[75113]:   </os>
Oct 26 17:17:26 user nova-compute[75113]:   <features>
Oct 26 17:17:26 user nova-compute[75113]:     <acpi/>
Oct 26 17:17:26 user nova-compute[75113]:     <apic/>
Oct 26 17:17:26 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:17:26 user nova-compute[75113]:   </features>
Oct 26 17:17:26 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:17:26 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:17:26 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:17:26 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:17:26 user nova-compute[75113]:   </clock>
Oct 26 17:17:26 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:17:26 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:17:26 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:17:26 user nova-compute[75113]:   </cpu>
Oct 26 17:17:26 user nova-compute[75113]:   <devices>
Oct 26 17:17:26 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:17:26 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:17:26 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk"/>
Oct 26 17:17:26 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:17:26 user nova-compute[75113]:     </disk>
Oct 26 17:17:26 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:17:26 user nova-compute[75113]:       <mac address="fa:16:3e:b4:37:33"/>
Oct 26 17:17:26 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:17:26 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:17:26 user nova-compute[75113]:       <target dev="tap9c8d391d-ef"/>
Oct 26 17:17:26 user nova-compute[75113]:     </interface>
Oct 26 17:17:26 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:17:26 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/console.log" append="off"/>
Oct 26 17:17:26 user nova-compute[75113]:     </serial>
Oct 26 17:17:26 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:17:26 user nova-compute[75113]:     <video>
Oct 26 17:17:26 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:17:26 user nova-compute[75113]:     </video>
Oct 26 17:17:26 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:17:26 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:17:26 user nova-compute[75113]:     </rng>
Oct 26 17:17:26 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:17:26 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:17:26 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:17:26 user nova-compute[75113]:     </memballoon>
Oct 26 17:17:26 user nova-compute[75113]:   </devices>
Oct 26 17:17:26 user nova-compute[75113]: </domain>
Oct 26 17:17:26 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-863488592',display_name='tempest-TestStampPattern-server-863488592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-863488592',id=36,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWHyhdWG4vODww4J36tjcUt2ICXtezA7tiJccfBwgDPh+GMN+tQKBdFq+33nqzyfrbTLq8kX7WTafkfAiBXerZ2BCl1jBxwv1h0P5P+b6z5qmRWoytp+RGBDhwGCxEyfQ==',key_name='tempest-TestStampPattern-754663238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95d413c67bd3476cbfeb8e39af59e9ee',ramdisk_id='',reservation_id='r-jx3aex1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1797568490',owner_user_name='tempest-TestStampPattern-1797568490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:17:25Z,user_data=None,user_id='cf60300c4d874a99a5a99bef82641993',uuid=fc80403d-8fbd-4836-8d01-89fa7aad8d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Converting VIF {"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:37:33,bridge_name='br-int',has_traffic_filtering=True,id=9c8d391d-ef18-4deb-9312-f9667d6362ea,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8d391d-ef') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG os_vif [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:37:33,bridge_name='br-int',has_traffic_filtering=True,id=9c8d391d-ef18-4deb-9312-f9667d6362ea,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8d391d-ef') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c8a148f-0c03-506f-82d6-e96d62a8a219', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c8d391d-ef, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c8d391d-ef, col_values=(('qos', UUID('d069062f-645c-416a-8926-cdc2b93d154f')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c8d391d-ef, col_values=(('external_ids', {'iface-id': '9c8d391d-ef18-4deb-9312-f9667d6362ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:37:33', 'vm-uuid': 'fc80403d-8fbd-4836-8d01-89fa7aad8d7e'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:17:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:26 user nova-compute[75113]: INFO os_vif [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:37:33,bridge_name='br-int',has_traffic_filtering=True,id=9c8d391d-ef18-4deb-9312-f9667d6362ea,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8d391d-ef')
Oct 26 17:17:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:17:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] No VIF found with MAC fa:16:3e:b4:37:33, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:17:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:27 user nova-compute[75113]: DEBUG nova.network.neutron [req-9ef123f3-3c8f-48dd-a743-ec3e8014ddfe req-d1417509-f599-4c98-928a-1b4eb11ee903 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updated VIF entry in instance network info cache for port 9c8d391d-ef18-4deb-9312-f9667d6362ea. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:17:27 user nova-compute[75113]: DEBUG nova.network.neutron [req-9ef123f3-3c8f-48dd-a743-ec3e8014ddfe req-d1417509-f599-4c98-928a-1b4eb11ee903 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updating instance_info_cache with network_info: [{"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:17:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9ef123f3-3c8f-48dd-a743-ec3e8014ddfe req-d1417509-f599-4c98-928a-1b4eb11ee903 service nova] Releasing lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:17:27 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:17:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-608c5a30-ce86-46a2-bcc3-a7387a55b5ec req-e2b1cf80-4673-441f-bbe9-4501f973b054 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Received event network-vif-plugged-9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-608c5a30-ce86-46a2-bcc3-a7387a55b5ec req-e2b1cf80-4673-441f-bbe9-4501f973b054 service nova] Acquiring lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-608c5a30-ce86-46a2-bcc3-a7387a55b5ec req-e2b1cf80-4673-441f-bbe9-4501f973b054 service nova] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-608c5a30-ce86-46a2-bcc3-a7387a55b5ec req-e2b1cf80-4673-441f-bbe9-4501f973b054 service nova] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-608c5a30-ce86-46a2-bcc3-a7387a55b5ec req-e2b1cf80-4673-441f-bbe9-4501f973b054 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] No waiting events found dispatching network-vif-plugged-9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:17:28 user nova-compute[75113]: WARNING nova.compute.manager [req-608c5a30-ce86-46a2-bcc3-a7387a55b5ec req-e2b1cf80-4673-441f-bbe9-4501f973b054 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Received unexpected event network-vif-plugged-9c8d391d-ef18-4deb-9312-f9667d6362ea for instance with vm_state building and task_state spawning.
Oct 26 17:17:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:30 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:17:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:17:30 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Instance spawned successfully.
Oct 26 17:17:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:17:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:17:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:17:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:17:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:17:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:17:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:17:30 user nova-compute[75113]: INFO nova.compute.manager [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Took 5.29 seconds to spawn the instance on the hypervisor.
Oct 26 17:17:30 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:17:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-89eaa9d8-87bd-45b1-b913-c013dfb2c856 req-2f560592-4987-4261-8137-2d7e39661aeb service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Received event network-vif-plugged-9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-89eaa9d8-87bd-45b1-b913-c013dfb2c856 req-2f560592-4987-4261-8137-2d7e39661aeb service nova] Acquiring lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-89eaa9d8-87bd-45b1-b913-c013dfb2c856 req-2f560592-4987-4261-8137-2d7e39661aeb service nova] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-89eaa9d8-87bd-45b1-b913-c013dfb2c856 req-2f560592-4987-4261-8137-2d7e39661aeb service nova] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-89eaa9d8-87bd-45b1-b913-c013dfb2c856 req-2f560592-4987-4261-8137-2d7e39661aeb service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] No waiting events found dispatching network-vif-plugged-9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:17:30 user nova-compute[75113]: WARNING nova.compute.manager [req-89eaa9d8-87bd-45b1-b913-c013dfb2c856 req-2f560592-4987-4261-8137-2d7e39661aeb service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Received unexpected event network-vif-plugged-9c8d391d-ef18-4deb-9312-f9667d6362ea for instance with vm_state building and task_state spawning.
Oct 26 17:17:30 user nova-compute[75113]: INFO nova.compute.manager [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Took 6.40 seconds to build instance.
Oct 26 17:17:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55d7014c-f8ee-46fa-a7f9-78d29ecac627 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.503s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:39 user nova-compute[75113]: DEBUG nova.objects.instance [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'flavor' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:17:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquired lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.network.neutron [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.objects.instance [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'info_cache' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.objects.base [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.network.neutron [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Updating instance_info_cache with network_info: [{"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Releasing lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:17:40 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: e216e427-7231-4491-85f8-607c930e0d43] Instance destroyed successfully.
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.objects.instance [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'resources' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.objects.base [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1800361624',display_name='tempest-AttachVolumeTestJSON-server-1800361624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1800361624',id=30,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM0mtS1dljg4Qu1gGqqTeuT9mq/sIHwVu/5XUkXKrM/OqcCuxLS9BGabMHGaDAN2pPR3pksc+bfFVi23MZQGdlYQu9QfNjCvEVQbShJMteVLFo3IenVFiQim0F4GoqwcQ==',key_name='tempest-keypair-618389938',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ecfe1e4023f641d6b492c7a0d0fc033b',ramdisk_id='',reservation_id='r-hj3gqi9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1430222675',owner_user_name='tempest-AttachVolumeTestJSON-1430222675-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:15:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b04592754c6c406e9d550e9036fe9ea7',uuid=e216e427-7231-4491-85f8-607c930e0d43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converting VIF {"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG os_vif [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab4b54e0-28, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b07a059e-b9d3-4d95-9c9f-5265842dac1c) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:40 user nova-compute[75113]: INFO os_vif [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28')
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Start _get_guest_xml network_info=[{"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.objects.instance [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'numa_topology' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.objects.base [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:17:40 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:17:40 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.objects.instance [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'vcpu_model' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.objects.base [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1800361624',display_name='tempest-AttachVolumeTestJSON-server-1800361624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1800361624',id=30,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM0mtS1dljg4Qu1gGqqTeuT9mq/sIHwVu/5XUkXKrM/OqcCuxLS9BGabMHGaDAN2pPR3pksc+bfFVi23MZQGdlYQu9QfNjCvEVQbShJMteVLFo3IenVFiQim0F4GoqwcQ==',key_name='tempest-keypair-618389938',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ecfe1e4023f641d6b492c7a0d0fc033b',ramdisk_id='',reservation_id='r-hj3gqi9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1430222675',owner_user_name='tempest-AttachVolumeTestJSON-1430222675-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:15:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b04592754c6c406e9d550e9036fe9ea7',uuid=e216e427-7231-4491-85f8-607c930e0d43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converting VIF {"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.objects.instance [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'pci_devices' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.objects.base [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:17:40 user nova-compute[75113]:   <uuid>e216e427-7231-4491-85f8-607c930e0d43</uuid>
Oct 26 17:17:40 user nova-compute[75113]:   <name>instance-0000001e</name>
Oct 26 17:17:40 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:17:40 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:17:40 user nova-compute[75113]:   <metadata>
Oct 26 17:17:40 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:17:40 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:17:40 user nova-compute[75113]:       <nova:name>tempest-AttachVolumeTestJSON-server-1800361624</nova:name>
Oct 26 17:17:40 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:17:40</nova:creationTime>
Oct 26 17:17:40 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:17:40 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:17:40 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:17:40 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:17:40 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:17:40 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:17:40 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:17:40 user nova-compute[75113]:       <nova:owner>
Oct 26 17:17:40 user nova-compute[75113]:         <nova:user uuid="b04592754c6c406e9d550e9036fe9ea7">tempest-AttachVolumeTestJSON-1430222675-project-member</nova:user>
Oct 26 17:17:40 user nova-compute[75113]:         <nova:project uuid="ecfe1e4023f641d6b492c7a0d0fc033b">tempest-AttachVolumeTestJSON-1430222675</nova:project>
Oct 26 17:17:40 user nova-compute[75113]:       </nova:owner>
Oct 26 17:17:40 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:17:40 user nova-compute[75113]:       <nova:ports>
Oct 26 17:17:40 user nova-compute[75113]:         <nova:port uuid="ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8">
Oct 26 17:17:40 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 17:17:40 user nova-compute[75113]:         </nova:port>
Oct 26 17:17:40 user nova-compute[75113]:       </nova:ports>
Oct 26 17:17:40 user nova-compute[75113]:     </nova:instance>
Oct 26 17:17:40 user nova-compute[75113]:   </metadata>
Oct 26 17:17:40 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:17:40 user nova-compute[75113]:     <system>
Oct 26 17:17:40 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:17:40 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:17:40 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:17:40 user nova-compute[75113]:       <entry name="serial">e216e427-7231-4491-85f8-607c930e0d43</entry>
Oct 26 17:17:40 user nova-compute[75113]:       <entry name="uuid">e216e427-7231-4491-85f8-607c930e0d43</entry>
Oct 26 17:17:40 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:17:40 user nova-compute[75113]:     </system>
Oct 26 17:17:40 user nova-compute[75113]:   </sysinfo>
Oct 26 17:17:40 user nova-compute[75113]:   <os>
Oct 26 17:17:40 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:17:40 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:17:40 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:17:40 user nova-compute[75113]:   </os>
Oct 26 17:17:40 user nova-compute[75113]:   <features>
Oct 26 17:17:40 user nova-compute[75113]:     <acpi/>
Oct 26 17:17:40 user nova-compute[75113]:     <apic/>
Oct 26 17:17:40 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:17:40 user nova-compute[75113]:   </features>
Oct 26 17:17:40 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:17:40 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:17:40 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:17:40 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:17:40 user nova-compute[75113]:   </clock>
Oct 26 17:17:40 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:17:40 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:17:40 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:17:40 user nova-compute[75113]:   </cpu>
Oct 26 17:17:40 user nova-compute[75113]:   <devices>
Oct 26 17:17:40 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:17:40 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:17:40 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk"/>
Oct 26 17:17:40 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:17:40 user nova-compute[75113]:     </disk>
Oct 26 17:17:40 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:17:40 user nova-compute[75113]:       <mac address="fa:16:3e:d6:32:fd"/>
Oct 26 17:17:40 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:17:40 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:17:40 user nova-compute[75113]:       <target dev="tapab4b54e0-28"/>
Oct 26 17:17:40 user nova-compute[75113]:     </interface>
Oct 26 17:17:40 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:17:40 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/console.log" append="off"/>
Oct 26 17:17:40 user nova-compute[75113]:     </serial>
Oct 26 17:17:40 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:17:40 user nova-compute[75113]:     <video>
Oct 26 17:17:40 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:17:40 user nova-compute[75113]:     </video>
Oct 26 17:17:40 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:17:40 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:17:40 user nova-compute[75113]:     </rng>
Oct 26 17:17:40 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:17:40 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:17:40 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:17:40 user nova-compute[75113]:     </memballoon>
Oct 26 17:17:40 user nova-compute[75113]:   </devices>
Oct 26 17:17:40 user nova-compute[75113]: </domain>
Oct 26 17:17:40 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:40 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG nova.objects.instance [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'trusted_certs' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG nova.objects.base [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Cannot resize image /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG nova.objects.instance [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'migration_context' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG nova.objects.base [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Object Instance<e216e427-7231-4491-85f8-607c930e0d43> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1800361624',display_name='tempest-AttachVolumeTestJSON-server-1800361624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1800361624',id=30,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM0mtS1dljg4Qu1gGqqTeuT9mq/sIHwVu/5XUkXKrM/OqcCuxLS9BGabMHGaDAN2pPR3pksc+bfFVi23MZQGdlYQu9QfNjCvEVQbShJMteVLFo3IenVFiQim0F4GoqwcQ==',key_name='tempest-keypair-618389938',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ecfe1e4023f641d6b492c7a0d0fc033b',ramdisk_id='',reservation_id='r-hj3gqi9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1430222675',owner_user_name='tempest-AttachVolumeTestJSON-1430222675-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:15:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b04592754c6c406e9d550e9036fe9ea7',uuid=e216e427-7231-4491-85f8-607c930e0d43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converting VIF {"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG os_vif [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '896bf060-4b82-54dd-9a9d-1bfb5c42f794', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab4b54e0-28, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab4b54e0-28, col_values=(('qos', UUID('d82167eb-a4fb-4f50-bba8-1dcf6996f481')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab4b54e0-28, col_values=(('external_ids', {'iface-id': 'ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:32:fd', 'vm-uuid': 'e216e427-7231-4491-85f8-607c930e0d43'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:17:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:41 user nova-compute[75113]: INFO os_vif [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28')
Oct 26 17:17:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:43 user nova-compute[75113]: DEBUG nova.compute.manager [req-299f0abd-0d85-4bd6-bf6b-70acfc05dfa0 req-8a23944a-045d-4d31-ae47-394c6002df20 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-299f0abd-0d85-4bd6-bf6b-70acfc05dfa0 req-8a23944a-045d-4d31-ae47-394c6002df20 service nova] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-299f0abd-0d85-4bd6-bf6b-70acfc05dfa0 req-8a23944a-045d-4d31-ae47-394c6002df20 service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-299f0abd-0d85-4bd6-bf6b-70acfc05dfa0 req-8a23944a-045d-4d31-ae47-394c6002df20 service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:43 user nova-compute[75113]: DEBUG nova.compute.manager [req-299f0abd-0d85-4bd6-bf6b-70acfc05dfa0 req-8a23944a-045d-4d31-ae47-394c6002df20 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] No waiting events found dispatching network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:17:43 user nova-compute[75113]: WARNING nova.compute.manager [req-299f0abd-0d85-4bd6-bf6b-70acfc05dfa0 req-8a23944a-045d-4d31-ae47-394c6002df20 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received unexpected event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 for instance with vm_state stopped and task_state powering-on.
Oct 26 17:17:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:17:44 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: e216e427-7231-4491-85f8-607c930e0d43] Instance rebooted successfully.
Oct 26 17:17:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-80ad47de-cb2f-481d-ae27-178c48c5e81e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "644032e4-b692-4608-9fd2-f1c609fd766d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "644032e4-b692-4608-9fd2-f1c609fd766d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:45 user nova-compute[75113]: INFO nova.compute.manager [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Terminating instance
Oct 26 17:17:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-7486938c-8f76-454a-8fc7-a60b1370874a req-654e56a0-82bc-4c2f-90d2-973b8136700c service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7486938c-8f76-454a-8fc7-a60b1370874a req-654e56a0-82bc-4c2f-90d2-973b8136700c service nova] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7486938c-8f76-454a-8fc7-a60b1370874a req-654e56a0-82bc-4c2f-90d2-973b8136700c service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7486938c-8f76-454a-8fc7-a60b1370874a req-654e56a0-82bc-4c2f-90d2-973b8136700c service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-7486938c-8f76-454a-8fc7-a60b1370874a req-654e56a0-82bc-4c2f-90d2-973b8136700c service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] No waiting events found dispatching network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:17:45 user nova-compute[75113]: WARNING nova.compute.manager [req-7486938c-8f76-454a-8fc7-a60b1370874a req-654e56a0-82bc-4c2f-90d2-973b8136700c service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received unexpected event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 for instance with vm_state active and task_state None.
Oct 26 17:17:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-a98ce2b9-e4bf-4bf3-8ac9-09dcaa1246da req-68c85386-aeeb-48c0-84ff-d61133586690 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received event network-vif-unplugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a98ce2b9-e4bf-4bf3-8ac9-09dcaa1246da req-68c85386-aeeb-48c0-84ff-d61133586690 service nova] Acquiring lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a98ce2b9-e4bf-4bf3-8ac9-09dcaa1246da req-68c85386-aeeb-48c0-84ff-d61133586690 service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a98ce2b9-e4bf-4bf3-8ac9-09dcaa1246da req-68c85386-aeeb-48c0-84ff-d61133586690 service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-a98ce2b9-e4bf-4bf3-8ac9-09dcaa1246da req-68c85386-aeeb-48c0-84ff-d61133586690 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] No waiting events found dispatching network-vif-unplugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-a98ce2b9-e4bf-4bf3-8ac9-09dcaa1246da req-68c85386-aeeb-48c0-84ff-d61133586690 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received event network-vif-unplugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:45 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Instance destroyed successfully.
Oct 26 17:17:45 user nova-compute[75113]: DEBUG nova.objects.instance [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lazy-loading 'resources' on Instance uuid 644032e4-b692-4608-9fd2-f1c609fd766d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-93320350',display_name='tempest-ServerActionsTestOtherA-server-93320350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-93320350',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJUID7/sgaW7v1qEz5yD7qPGwhwC+8ZuDRQIBbpLrTvyGuQpgvdE4GCh2rNno39iufUQMngc4uPWtbJQKyjANVZtkRT2aaUI7mWC3EKIsR7qjErlpC+wkdFBgM3eTSeRw==',key_name='tempest-keypair-536776118',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:13:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-yzll3wm0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:14:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=644032e4-b692-4608-9fd2-f1c609fd766d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "address": "fa:16:3e:3b:b4:50", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4cb377-3b", "ovs_interfaceid": "dc4cb377-3bfa-4500-bbb9-a86c6fc30a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG os_vif [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc4cb377-3b, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4483f7d2-d0ca-4d41-82d4-a2d9e54951cb) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:45 user nova-compute[75113]: INFO os_vif [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:b4:50,bridge_name='br-int',has_traffic_filtering=True,id=dc4cb377-3bfa-4500-bbb9-a86c6fc30a64,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4cb377-3b')
Oct 26 17:17:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrXfbwWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:17:45 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:17:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd89d18e-73a9-41fc-90d3-dbc150fe3178]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:17:45 user nova-compute[75113]: No targets found.
Oct 26 17:17:45 user nova-compute[75113]: iSNS:
Oct 26 17:17:45 user nova-compute[75113]: No targets found.
Oct 26 17:17:45 user nova-compute[75113]: STATIC:
Oct 26 17:17:45 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:17:45 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:17:45 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:17:45 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf
Oct 26 17:17:45 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:17:45 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:17:45 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72
Oct 26 17:17:45 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:17:45 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:17:45 user nova-compute[75113]: FIRMWARE:
Oct 26 17:17:45 user nova-compute[75113]: No targets found.
Oct 26 17:17:45 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:17:45 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:17:45 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7da8ee-fdbc-434f-aec7-24113faf6fda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1436242d-b5a9-4bc0-8a22-8c81c676b0d5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:17:46 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:17:46 user nova-compute[75113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)
Oct 26 17:17:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:17:46 user nova-compute[75113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 (non-flash)
Oct 26 17:17:46 user nova-compute[75113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)
Oct 26 17:17:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f491428bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72'): ({'sdc'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Removing single pathed devices sdc {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[25615f1b-c7ea-4d85-96e9-971134cf7b46]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bcbed2-00a8-43a3-8e3c-772a5d610105]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Flushing IO for device /dev/sdc {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf81063-4709-4a80-99e0-6df2d6bc901f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bac9426-fee6-4602-81b9-73b744477cd7]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ab65a6-24e5-4f96-8aaa-980a8a753fbe]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d7921a-90dc-42a9-bb6d-b05617b595a6]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260]
Oct 26 17:17:46 user nova-compute[75113]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72, portal: 172.16.0.220,3260] successful.
Oct 26 17:17:46 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cc1431-264b-409a-b2a3-fec3a92d4c72 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f146891-f87b-44e3-9658-51b304c09295]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] <== disconnect_volume: return (324ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:17:46 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Deleting instance files /opt/stack/data/nova/instances/644032e4-b692-4608-9fd2-f1c609fd766d_del
Oct 26 17:17:46 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Deletion of /opt/stack/data/nova/instances/644032e4-b692-4608-9fd2-f1c609fd766d_del complete
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:46 user nova-compute[75113]: INFO nova.compute.manager [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Detaching volume 1cc7688c-674a-43dd-b9ec-936cd0d5dbdf
Oct 26 17:17:46 user nova-compute[75113]: INFO nova.compute.manager [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 26 17:17:46 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:17:46 user nova-compute[75113]: INFO nova.virt.block_device [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Attempting to driver detach volume 1cc7688c-674a-43dd-b9ec-936cd0d5dbdf from mountpoint /dev/vdb
Oct 26 17:17:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Attempting to detach device vdb from instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:17:46 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:17:46 user nova-compute[75113]:   <source dev="/dev/sdg"/>
Oct 26 17:17:46 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:17:46 user nova-compute[75113]:   <serial>1cc7688c-674a-43dd-b9ec-936cd0d5dbdf</serial>
Oct 26 17:17:46 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:17:46 user nova-compute[75113]: </disk>
Oct 26 17:17:46 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:17:46 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Successfully detached device vdb from instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d from the persistent domain config.
Oct 26 17:17:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:17:46 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:17:46 user nova-compute[75113]:   <source dev="/dev/sdg"/>
Oct 26 17:17:46 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:17:46 user nova-compute[75113]:   <serial>1cc7688c-674a-43dd-b9ec-936cd0d5dbdf</serial>
Oct 26 17:17:46 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:17:46 user nova-compute[75113]: </disk>
Oct 26 17:17:46 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:17:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:17:47 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Took 0.79 seconds to deallocate network for instance.
Oct 26 17:17:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-changed-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Refreshing instance network info cache due to event network-changed-1dc2c484-d507-4733-8b3f-90f89494e166. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] Acquiring lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] Acquired lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG nova.network.neutron [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Refreshing network info cache for port 1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8eaca23-f922-4176-8cb0-b9e3134e72be req-bacf1e3e-0892-4601-9474-b07eb62710d0 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received event network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8eaca23-f922-4176-8cb0-b9e3134e72be req-bacf1e3e-0892-4601-9474-b07eb62710d0 service nova] Acquiring lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8eaca23-f922-4176-8cb0-b9e3134e72be req-bacf1e3e-0892-4601-9474-b07eb62710d0 service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8eaca23-f922-4176-8cb0-b9e3134e72be req-bacf1e3e-0892-4601-9474-b07eb62710d0 service nova] Lock "644032e4-b692-4608-9fd2-f1c609fd766d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8eaca23-f922-4176-8cb0-b9e3134e72be req-bacf1e3e-0892-4601-9474-b07eb62710d0 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] No waiting events found dispatching network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:17:47 user nova-compute[75113]: WARNING nova.compute.manager [req-e8eaca23-f922-4176-8cb0-b9e3134e72be req-bacf1e3e-0892-4601-9474-b07eb62710d0 service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received unexpected event network-vif-plugged-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 for instance with vm_state active and task_state deleting.
Oct 26 17:17:47 user nova-compute[75113]: DEBUG nova.network.neutron [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updated VIF entry in instance network info cache for port 1dc2c484-d507-4733-8b3f-90f89494e166. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG nova.network.neutron [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updating instance_info_cache with network_info: [{"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] Releasing lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-changed-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Refreshing instance network info cache due to event network-changed-1dc2c484-d507-4733-8b3f-90f89494e166. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] Acquiring lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] Acquired lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:17:47 user nova-compute[75113]: DEBUG nova.network.neutron [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Refreshing network info cache for port 1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:17:48 user nova-compute[75113]: DEBUG nova.network.neutron [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updated VIF entry in instance network info cache for port 1dc2c484-d507-4733-8b3f-90f89494e166. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:17:48 user nova-compute[75113]: DEBUG nova.network.neutron [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updating instance_info_cache with network_info: [{"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:17:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] Releasing lock "refresh_cache-296a09d4-ed82-4876-9fbd-baadff6a7b4d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:17:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-6f6fb245-5305-4a7f-8699-0bbbdd2b1dbd req-c9dd0b83-841c-423f-9c35-a8e42b0c2fae service nova] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Received event network-vif-deleted-dc4cb377-3bfa-4500-bbb9-a86c6fc30a64 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:48 user nova-compute[75113]: INFO nova.compute.manager [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Took 1.12 seconds to detach 1 volumes for instance.
Oct 26 17:17:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: 644032e4-b692-4608-9fd2-f1c609fd766d] Deleting volume: b7cc1431-264b-409a-b2a3-fec3a92d4c72 {{(pid=75113) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 17:17:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:48 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:17:48 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:17:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:48 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Deleted allocations for instance 644032e4-b692-4608-9fd2-f1c609fd766d
Oct 26 17:17:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-db4560f5-0dec-42d7-bb27-a3edfc946316 tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "644032e4-b692-4608-9fd2-f1c609fd766d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.779s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "7cbb27a2-37c5-4045-a005-719f79f30714" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "7cbb27a2-37c5-4045-a005-719f79f30714" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:57 user nova-compute[75113]: INFO nova.compute.manager [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Terminating instance
Oct 26 17:17:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-a365d327-912a-41c6-b4b3-ad342c8caf99 req-e6991387-126a-4be6-a79a-f238a180387e service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Received event network-vif-unplugged-9423387c-270f-462d-bae1-c28813953dc9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a365d327-912a-41c6-b4b3-ad342c8caf99 req-e6991387-126a-4be6-a79a-f238a180387e service nova] Acquiring lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a365d327-912a-41c6-b4b3-ad342c8caf99 req-e6991387-126a-4be6-a79a-f238a180387e service nova] Lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a365d327-912a-41c6-b4b3-ad342c8caf99 req-e6991387-126a-4be6-a79a-f238a180387e service nova] Lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-a365d327-912a-41c6-b4b3-ad342c8caf99 req-e6991387-126a-4be6-a79a-f238a180387e service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] No waiting events found dispatching network-vif-unplugged-9423387c-270f-462d-bae1-c28813953dc9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-a365d327-912a-41c6-b4b3-ad342c8caf99 req-e6991387-126a-4be6-a79a-f238a180387e service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Received event network-vif-unplugged-9423387c-270f-462d-bae1-c28813953dc9 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:58 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Instance destroyed successfully.
Oct 26 17:17:58 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'resources' on Instance uuid 7cbb27a2-37c5-4045-a005-719f79f30714 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-37723291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-37723291',id=28,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:07:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-b6ygjdbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:09:42Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=7cbb27a2-37c5-4045-a005-719f79f30714,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9423387c-270f-462d-bae1-c28813953dc9", "address": "fa:16:3e:ab:e3:d2", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9423387c-27", "ovs_interfaceid": "9423387c-270f-462d-bae1-c28813953dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "9423387c-270f-462d-bae1-c28813953dc9", "address": "fa:16:3e:ab:e3:d2", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9423387c-27", "ovs_interfaceid": "9423387c-270f-462d-bae1-c28813953dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:e3:d2,bridge_name='br-int',has_traffic_filtering=True,id=9423387c-270f-462d-bae1-c28813953dc9,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9423387c-27') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG os_vif [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:e3:d2,bridge_name='br-int',has_traffic_filtering=True,id=9423387c-270f-462d-bae1-c28813953dc9,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9423387c-27') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9423387c-27, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=648c932f-369f-41e2-8c40-7f2e0b9a3ffb) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:17:58 user nova-compute[75113]: INFO os_vif [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:e3:d2,bridge_name='br-int',has_traffic_filtering=True,id=9423387c-270f-462d-bae1-c28813953dc9,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9423387c-27')
Oct 26 17:17:58 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Deleting instance files /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714_del
Oct 26 17:17:58 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Deletion of /opt/stack/data/nova/instances/7cbb27a2-37c5-4045-a005-719f79f30714_del complete
Oct 26 17:17:58 user nova-compute[75113]: INFO nova.compute.manager [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 17:17:58 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:17:58 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:17:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:17:59 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:17:59 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Took 0.42 seconds to deallocate network for instance.
Oct 26 17:17:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-e4141a56-2f04-43e1-90af-974a81c7eb4d req-5f82e1ab-a43a-4edc-b1b2-50afab1f8484 service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Received event network-vif-deleted-9423387c-270f-462d-bae1-c28813953dc9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:17:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:17:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:17:59 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:17:59 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:17:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:17:59 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Deleted allocations for instance 7cbb27a2-37c5-4045-a005-719f79f30714
Oct 26 17:17:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a3be4f31-3f33-4b96-8a5f-64018e46e1bc tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "7cbb27a2-37c5-4045-a005-719f79f30714" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.807s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-4371c6fb-192d-47ed-adc7-ed3dd9410ad4 req-0cbc101f-8ab6-47dd-99f7-11682e132ab4 service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Received event network-vif-plugged-9423387c-270f-462d-bae1-c28813953dc9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4371c6fb-192d-47ed-adc7-ed3dd9410ad4 req-0cbc101f-8ab6-47dd-99f7-11682e132ab4 service nova] Acquiring lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4371c6fb-192d-47ed-adc7-ed3dd9410ad4 req-0cbc101f-8ab6-47dd-99f7-11682e132ab4 service nova] Lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4371c6fb-192d-47ed-adc7-ed3dd9410ad4 req-0cbc101f-8ab6-47dd-99f7-11682e132ab4 service nova] Lock "7cbb27a2-37c5-4045-a005-719f79f30714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-4371c6fb-192d-47ed-adc7-ed3dd9410ad4 req-0cbc101f-8ab6-47dd-99f7-11682e132ab4 service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] No waiting events found dispatching network-vif-plugged-9423387c-270f-462d-bae1-c28813953dc9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:18:00 user nova-compute[75113]: WARNING nova.compute.manager [req-4371c6fb-192d-47ed-adc7-ed3dd9410ad4 req-0cbc101f-8ab6-47dd-99f7-11682e132ab4 service nova] [instance: 7cbb27a2-37c5-4045-a005-719f79f30714] Received unexpected event network-vif-plugged-9423387c-270f-462d-bae1-c28813953dc9 for instance with vm_state deleted and task_state None.
Oct 26 17:18:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:06 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d is timed out.
Oct 26 17:18:06 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Successfully detached device vdb from instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d from the live domain config.
Oct 26 17:18:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FCIwdoKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:18:06 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:18:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9825d58-ea1e-4045-8b46-96a46024eafb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:18:06 user nova-compute[75113]: No targets found.
Oct 26 17:18:06 user nova-compute[75113]: iSNS:
Oct 26 17:18:06 user nova-compute[75113]: No targets found.
Oct 26 17:18:06 user nova-compute[75113]: STATIC:
Oct 26 17:18:06 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:18:06 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:18:06 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:18:06 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf
Oct 26 17:18:06 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:18:06 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:18:06 user nova-compute[75113]: FIRMWARE:
Oct 26 17:18:06 user nova-compute[75113]: No targets found.
Oct 26 17:18:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:18:06 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:18:06 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b2b436-d516-4520-8cdb-e9507aea0037]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4add647f-72b9-42cb-890d-884dd75b8ead]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:18:06 user nova-compute[75113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)
Oct 26 17:18:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:18:06 user nova-compute[75113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf (non-flash)
Oct 26 17:18:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914747490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf'): ({'sdg'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Removing single pathed devices sdg {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f314b9de-0c6a-4051-8e74-7fd1c996c48c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a770c2-27dc-4aff-9b75-bded9435f7e0]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Flushing IO for device /dev/sdg {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[344aba6f-ac46-4fde-9efc-1c8842759699]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:18:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe83ed-92cc-4d52-a70f-105e9ca38231]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] SCSI volumes sdg have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e128a0c7-13f8-4dda-84fa-be0d88d1cc5b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ed73d9-4874-49d7-8e55-60e2ebf6afb4]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf, portal: 172.16.0.220,3260]
Oct 26 17:18:07 user nova-compute[75113]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf, portal: 172.16.0.220,3260] successful.
Oct 26 17:18:07 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc7688c-674a-43dd-b9ec-936cd0d5dbdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f84aa8-11cf-4d92-8bb3-dd6b750e5630]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] <== disconnect_volume: return (288ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:07 user nova-compute[75113]: DEBUG nova.objects.instance [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'flavor' on Instance uuid 296a09d4-ed82-4876-9fbd-baadff6a7b4d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:18:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3bba00c5-b221-4e81-a85e-f235caaefd37 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.721s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:10 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:18:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:13 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:18:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:14 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:18:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:14 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:18:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:18:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:18 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:18:18 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=7837MB free_disk=24.983306884765625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance ff2781bd-106d-4cdb-844c-41c58a191a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e216e427-7231-4491-85f8-607c930e0d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 8ef579e4-167c-42cf-bd7a-65d9862f5023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:18:23 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:18:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:18:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:18:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:18:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:18:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:18:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:18:23 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: e216e427-7231-4491-85f8-607c930e0d43] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:18:24 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: e216e427-7231-4491-85f8-607c930e0d43] Updating instance_info_cache with network_info: [{"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:18:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-e216e427-7231-4491-85f8-607c930e0d43" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:18:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: e216e427-7231-4491-85f8-607c930e0d43] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:18:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:18:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:18:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:18:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:18:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:18:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:29 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:18:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:18:35 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:18:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:36 user nova-compute[75113]: INFO nova.compute.manager [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Terminating instance
Oct 26 17:18:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:18:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-a9a4c009-d0e6-4445-9253-3a97a9c7903d req-14434bfa-c686-4207-8844-3cf5c12074e9 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-unplugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a9a4c009-d0e6-4445-9253-3a97a9c7903d req-14434bfa-c686-4207-8844-3cf5c12074e9 service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a9a4c009-d0e6-4445-9253-3a97a9c7903d req-14434bfa-c686-4207-8844-3cf5c12074e9 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a9a4c009-d0e6-4445-9253-3a97a9c7903d req-14434bfa-c686-4207-8844-3cf5c12074e9 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-a9a4c009-d0e6-4445-9253-3a97a9c7903d req-14434bfa-c686-4207-8844-3cf5c12074e9 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-unplugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:18:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-a9a4c009-d0e6-4445-9253-3a97a9c7903d req-14434bfa-c686-4207-8844-3cf5c12074e9 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-unplugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Instance destroyed successfully.
Oct 26 17:18:37 user nova-compute[75113]: DEBUG nova.objects.instance [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'resources' on Instance uuid 296a09d4-ed82-4876-9fbd-baadff6a7b4d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-171939011',display_name='tempest-ServerRescueNegativeTestJSON-server-171939011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-171939011',id=34,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz8QcdD1FR7/sQvuOZPE6yIwPGirxc4CN6QX5R+wZD/RSeomRaSXT5JTGKOpbc8DTjBxJsSxt56JvBM7TyteiBKrqg33rwF5tZW6dy/Rjbi3A18gcFNDKc5E41jE9Rtig==',key_name='tempest-keypair-147762484',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:14:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d11c5d88b2f4a45acee2e9c7d26043a',ramdisk_id='',reservation_id='r-jyqvj4zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760587308',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760587308-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:15:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa8e21aab014ce6ace0109878275b8f',uuid=296a09d4-ed82-4876-9fbd-baadff6a7b4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converting VIF {"id": "1dc2c484-d507-4733-8b3f-90f89494e166", "address": "fa:16:3e:75:78:27", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc2c484-d5", "ovs_interfaceid": "1dc2c484-d507-4733-8b3f-90f89494e166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:78:27,bridge_name='br-int',has_traffic_filtering=True,id=1dc2c484-d507-4733-8b3f-90f89494e166,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc2c484-d5') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG os_vif [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:78:27,bridge_name='br-int',has_traffic_filtering=True,id=1dc2c484-d507-4733-8b3f-90f89494e166,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc2c484-d5') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dc2c484-d5, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c9180a6-dafc-4e41-9df7-b3b2d697a7db) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:18:37 user nova-compute[75113]: INFO os_vif [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:78:27,bridge_name='br-int',has_traffic_filtering=True,id=1dc2c484-d507-4733-8b3f-90f89494e166,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc2c484-d5')
Oct 26 17:18:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Deleting instance files /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d_del
Oct 26 17:18:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Deletion of /opt/stack/data/nova/instances/296a09d4-ed82-4876-9fbd-baadff6a7b4d_del complete
Oct 26 17:18:37 user nova-compute[75113]: INFO nova.compute.manager [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 26 17:18:37 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:18:38 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Took 0.64 seconds to deallocate network for instance.
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-cd93bc17-6b26-4062-8697-6074427fb3c2 req-48188ffb-6de0-4fd9-bca8-f51bfc0e5704 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-deleted-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:38 user nova-compute[75113]: INFO nova.compute.manager [req-cd93bc17-6b26-4062-8697-6074427fb3c2 req-48188ffb-6de0-4fd9-bca8-f51bfc0e5704 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Neutron deleted interface 1dc2c484-d507-4733-8b3f-90f89494e166; detaching it from the instance and deleting it from the info cache
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.network.neutron [req-cd93bc17-6b26-4062-8697-6074427fb3c2 req-48188ffb-6de0-4fd9-bca8-f51bfc0e5704 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-cd93bc17-6b26-4062-8697-6074427fb3c2 req-48188ffb-6de0-4fd9-bca8-f51bfc0e5704 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Detach interface failed, port_id=1dc2c484-d507-4733-8b3f-90f89494e166, reason: Instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:38 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Deleted allocations for instance 296a09d4-ed82-4876-9fbd-baadff6a7b4d
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-5a59839d-bd68-4c62-969c-4789dd6f6160 tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.016s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-0435cd77-6008-4c04-a1df-68f513a50db4 req-ee92817e-10c1-4010-9f6f-cfefa8cb3d9a service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Received event network-changed-836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-0435cd77-6008-4c04-a1df-68f513a50db4 req-ee92817e-10c1-4010-9f6f-cfefa8cb3d9a service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Refreshing instance network info cache due to event network-changed-836188fa-7993-45db-b0e8-4fc2209a9785. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0435cd77-6008-4c04-a1df-68f513a50db4 req-ee92817e-10c1-4010-9f6f-cfefa8cb3d9a service nova] Acquiring lock "refresh_cache-8ef579e4-167c-42cf-bd7a-65d9862f5023" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0435cd77-6008-4c04-a1df-68f513a50db4 req-ee92817e-10c1-4010-9f6f-cfefa8cb3d9a service nova] Acquired lock "refresh_cache-8ef579e4-167c-42cf-bd7a-65d9862f5023" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.network.neutron [req-0435cd77-6008-4c04-a1df-68f513a50db4 req-ee92817e-10c1-4010-9f6f-cfefa8cb3d9a service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Refreshing network info cache for port 836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:18:38 user nova-compute[75113]: WARNING nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state deleted and task_state None.
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:18:38 user nova-compute[75113]: WARNING nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state deleted and task_state None.
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:18:38 user nova-compute[75113]: WARNING nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state deleted and task_state None.
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-unplugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-unplugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:18:38 user nova-compute[75113]: WARNING nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-unplugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state deleted and task_state None.
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Acquiring lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] Lock "296a09d4-ed82-4876-9fbd-baadff6a7b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] No waiting events found dispatching network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:18:38 user nova-compute[75113]: WARNING nova.compute.manager [req-874ae7c7-084b-401f-99ad-d1ddc9badeb8 req-936032a1-a7cd-4819-901d-037f285eba96 service nova] [instance: 296a09d4-ed82-4876-9fbd-baadff6a7b4d] Received unexpected event network-vif-plugged-1dc2c484-d507-4733-8b3f-90f89494e166 for instance with vm_state deleted and task_state None.
Oct 26 17:18:39 user nova-compute[75113]: DEBUG nova.network.neutron [req-0435cd77-6008-4c04-a1df-68f513a50db4 req-ee92817e-10c1-4010-9f6f-cfefa8cb3d9a service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Updated VIF entry in instance network info cache for port 836188fa-7993-45db-b0e8-4fc2209a9785. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG nova.network.neutron [req-0435cd77-6008-4c04-a1df-68f513a50db4 req-ee92817e-10c1-4010-9f6f-cfefa8cb3d9a service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Updating instance_info_cache with network_info: [{"id": "836188fa-7993-45db-b0e8-4fc2209a9785", "address": "fa:16:3e:14:57:0d", "network": {"id": "5ae68db4-1ba4-4cfb-8ce2-164950042964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1147509509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5c232b5ce547b18483b295e460c475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836188fa-79", "ovs_interfaceid": "836188fa-7993-45db-b0e8-4fc2209a9785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0435cd77-6008-4c04-a1df-68f513a50db4 req-ee92817e-10c1-4010-9f6f-cfefa8cb3d9a service nova] Releasing lock "refresh_cache-8ef579e4-167c-42cf-bd7a-65d9862f5023" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Acquiring lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lazy-loading 'flavor' on Instance uuid 8ef579e4-167c-42cf-bd7a-65d9862f5023 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Acquiring lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:39 user nova-compute[75113]: INFO nova.compute.manager [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Attaching volume 1288c48e-5db1-453e-96b2-51be0b509118 to /dev/vdb
Oct 26 17:18:39 user nova-compute[75113]: DEBUG os_brick.utils [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3362ac-56d4-4b8d-a71d-40fbdf2f793b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6ce190-88d9-401c-a429-44743a058497]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5599798-4307-4c9a-925e-951fd7aabe30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e691c0a-6658-486f-b21d-acf78b09b243]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:18:39 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:18:39 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b865641a-08c7-44bb-9102-1abc2065620d]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG os_brick.utils [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:18:39 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Updating existing volume attachment record: 2c9ee09b-b529-4d62-812f-b925c6500bed {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:18:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "ff2781bd-106d-4cdb-844c-41c58a191a88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:45 user nova-compute[75113]: INFO nova.compute.manager [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Terminating instance
Oct 26 17:18:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-c9f6d9fe-9a50-4836-9ca0-0a2f3c2c2a6c req-5d8249a3-27c7-4298-b479-4b9e7d16bc4f service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Received event network-vif-unplugged-a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c9f6d9fe-9a50-4836-9ca0-0a2f3c2c2a6c req-5d8249a3-27c7-4298-b479-4b9e7d16bc4f service nova] Acquiring lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c9f6d9fe-9a50-4836-9ca0-0a2f3c2c2a6c req-5d8249a3-27c7-4298-b479-4b9e7d16bc4f service nova] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c9f6d9fe-9a50-4836-9ca0-0a2f3c2c2a6c req-5d8249a3-27c7-4298-b479-4b9e7d16bc4f service nova] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-c9f6d9fe-9a50-4836-9ca0-0a2f3c2c2a6c req-5d8249a3-27c7-4298-b479-4b9e7d16bc4f service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] No waiting events found dispatching network-vif-unplugged-a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:18:45 user nova-compute[75113]: DEBUG nova.compute.manager [req-c9f6d9fe-9a50-4836-9ca0-0a2f3c2c2a6c req-5d8249a3-27c7-4298-b479-4b9e7d16bc4f service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Received event network-vif-unplugged-a1aedd8d-1f49-4949-9e8e-d1800971fd0f for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:18:46 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Instance destroyed successfully.
Oct 26 17:18:46 user nova-compute[75113]: DEBUG nova.objects.instance [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lazy-loading 'resources' on Instance uuid ff2781bd-106d-4cdb-844c-41c58a191a88 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1243004183',display_name='tempest-ServerActionsTestOtherA-server-1243004183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1243004183',id=14,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJUID7/sgaW7v1qEz5yD7qPGwhwC+8ZuDRQIBbpLrTvyGuQpgvdE4GCh2rNno39iufUQMngc4uPWtbJQKyjANVZtkRT2aaUI7mWC3EKIsR7qjErlpC+wkdFBgM3eTSeRw==',key_name='tempest-keypair-536776118',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:59:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e63bbd8ed7e4fc189d54c828d43e445',ramdisk_id='',reservation_id='r-5d1526no',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2074512325',owner_user_name='tempest-ServerActionsTestOtherA-2074512325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be611f9c83184dc29d232904a828b12a',uuid=ff2781bd-106d-4cdb-844c-41c58a191a88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converting VIF {"id": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "address": "fa:16:3e:94:28:0d", "network": {"id": "4cbf2b43-9f81-4507-a470-5bddec842812", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2046108746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e63bbd8ed7e4fc189d54c828d43e445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1aedd8d-1f", "ovs_interfaceid": "a1aedd8d-1f49-4949-9e8e-d1800971fd0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a1aedd8d-1f49-4949-9e8e-d1800971fd0f,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1aedd8d-1f') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG os_vif [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a1aedd8d-1f49-4949-9e8e-d1800971fd0f,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1aedd8d-1f') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1aedd8d-1f, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c2f1c10-6cd5-4f38-9e40-9fcf40b9e747) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:18:46 user nova-compute[75113]: INFO os_vif [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a1aedd8d-1f49-4949-9e8e-d1800971fd0f,network=Network(4cbf2b43-9f81-4507-a470-5bddec842812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1aedd8d-1f')
Oct 26 17:18:46 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Deleting instance files /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88_del
Oct 26 17:18:46 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Deletion of /opt/stack/data/nova/instances/ff2781bd-106d-4cdb-844c-41c58a191a88_del complete
Oct 26 17:18:46 user nova-compute[75113]: INFO nova.compute.manager [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 26 17:18:46 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:18:46 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Took 0.42 seconds to deallocate network for instance.
Oct 26 17:18:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-c2fb7343-c278-4263-b97c-0202924c40e0 req-0f6727df-60a6-48df-b0fd-9f9a262349d0 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Received event network-vif-deleted-a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:46 user nova-compute[75113]: INFO nova.compute.manager [req-c2fb7343-c278-4263-b97c-0202924c40e0 req-0f6727df-60a6-48df-b0fd-9f9a262349d0 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Neutron deleted interface a1aedd8d-1f49-4949-9e8e-d1800971fd0f; detaching it from the instance and deleting it from the info cache
Oct 26 17:18:46 user nova-compute[75113]: DEBUG nova.network.neutron [req-c2fb7343-c278-4263-b97c-0202924c40e0 req-0f6727df-60a6-48df-b0fd-9f9a262349d0 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-c2fb7343-c278-4263-b97c-0202924c40e0 req-0f6727df-60a6-48df-b0fd-9f9a262349d0 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Detach interface failed, port_id=a1aedd8d-1f49-4949-9e8e-d1800971fd0f, reason: Instance ff2781bd-106d-4cdb-844c-41c58a191a88 could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:47 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:18:47 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:18:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:47 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Deleted allocations for instance ff2781bd-106d-4cdb-844c-41c58a191a88
Oct 26 17:18:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-68092216-e8e9-4689-b5f0-1b70f332ce8f tempest-ServerActionsTestOtherA-2074512325 tempest-ServerActionsTestOtherA-2074512325-project-member] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.893s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-55aed9e7-6eeb-4ca8-9ec5-91add956759e req-e4c0a437-ce38-4725-91ec-cda3dd0e08c0 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Received event network-vif-plugged-a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55aed9e7-6eeb-4ca8-9ec5-91add956759e req-e4c0a437-ce38-4725-91ec-cda3dd0e08c0 service nova] Acquiring lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55aed9e7-6eeb-4ca8-9ec5-91add956759e req-e4c0a437-ce38-4725-91ec-cda3dd0e08c0 service nova] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55aed9e7-6eeb-4ca8-9ec5-91add956759e req-e4c0a437-ce38-4725-91ec-cda3dd0e08c0 service nova] Lock "ff2781bd-106d-4cdb-844c-41c58a191a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-55aed9e7-6eeb-4ca8-9ec5-91add956759e req-e4c0a437-ce38-4725-91ec-cda3dd0e08c0 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] No waiting events found dispatching network-vif-plugged-a1aedd8d-1f49-4949-9e8e-d1800971fd0f {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:18:47 user nova-compute[75113]: WARNING nova.compute.manager [req-55aed9e7-6eeb-4ca8-9ec5-91add956759e req-e4c0a437-ce38-4725-91ec-cda3dd0e08c0 service nova] [instance: ff2781bd-106d-4cdb-844c-41c58a191a88] Received unexpected event network-vif-plugged-a1aedd8d-1f49-4949-9e8e-d1800971fd0f for instance with vm_state deleted and task_state None.
Oct 26 17:18:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:48 user nova-compute[75113]: INFO nova.compute.manager [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Terminating instance
Oct 26 17:18:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-6fde714e-4b42-4d2e-afde-1f8b7ddd10a3 req-0c9ffc12-704c-4293-96bf-1348845d0408 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-unplugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6fde714e-4b42-4d2e-afde-1f8b7ddd10a3 req-0c9ffc12-704c-4293-96bf-1348845d0408 service nova] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6fde714e-4b42-4d2e-afde-1f8b7ddd10a3 req-0c9ffc12-704c-4293-96bf-1348845d0408 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6fde714e-4b42-4d2e-afde-1f8b7ddd10a3 req-0c9ffc12-704c-4293-96bf-1348845d0408 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-6fde714e-4b42-4d2e-afde-1f8b7ddd10a3 req-0c9ffc12-704c-4293-96bf-1348845d0408 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] No waiting events found dispatching network-vif-unplugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:18:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-6fde714e-4b42-4d2e-afde-1f8b7ddd10a3 req-0c9ffc12-704c-4293-96bf-1348845d0408 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-unplugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:18:49 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Instance destroyed successfully.
Oct 26 17:18:49 user nova-compute[75113]: DEBUG nova.objects.instance [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'resources' on Instance uuid 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1869311728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1869311728',id=18,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:04:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-a30od5ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:05:58Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=9593d2bd-4eaf-4cc6-a3ab-8766f769d32e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "address": "fa:16:3e:96:73:98", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8541b1-74", "ovs_interfaceid": "2f8541b1-74e9-4dd3-ad25-bcf31b21f605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:73:98,bridge_name='br-int',has_traffic_filtering=True,id=2f8541b1-74e9-4dd3-ad25-bcf31b21f605,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8541b1-74') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_vif [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:73:98,bridge_name='br-int',has_traffic_filtering=True,id=2f8541b1-74e9-4dd3-ad25-bcf31b21f605,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8541b1-74') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f8541b1-74, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93c5b66c-8c6d-4c71-b6b3-04a3040cbb14) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:18:49 user nova-compute[75113]: INFO os_vif [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:73:98,bridge_name='br-int',has_traffic_filtering=True,id=2f8541b1-74e9-4dd3-ad25-bcf31b21f605,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8541b1-74')
Oct 26 17:18:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBLDWhkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:18:49 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbd0e4a-74ed-4af1-b499-3bb95720d4a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:18:49 user nova-compute[75113]: No targets found.
Oct 26 17:18:49 user nova-compute[75113]: iSNS:
Oct 26 17:18:49 user nova-compute[75113]: No targets found.
Oct 26 17:18:49 user nova-compute[75113]: STATIC:
Oct 26 17:18:49 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c
Oct 26 17:18:49 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:18:49 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:18:49 user nova-compute[75113]: FIRMWARE:
Oct 26 17:18:49 user nova-compute[75113]: No targets found.
Oct 26 17:18:49 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:18:49 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:18:49 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cf5eb5-368f-4995-8ce7-942f71f313c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fc43f8-52d7-4580-9bcf-0c70323ccfe9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:18:49 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c (non-flash)
Oct 26 17:18:49 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f491411b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c'): ({'sdd'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Removing single pathed devices sdd {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1d7d48-8794-479e-800d-c0a1fd0283d8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[38669152-aa1c-4fac-80dd-449893520455]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Flushing IO for device /dev/sdd {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad7e154-a0e0-4e65-b977-490810e5686f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4c5bbd-1822-4298-a100-b8bc8f01d78b]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] SCSI volumes sdd have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fedb3bd-2cc5-4253-ab7a-6a9cdbeb1718]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[275cc955-dee1-481a-910f-fa7fc689b0a3]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c, portal: 172.16.0.220,3260]
Oct 26 17:18:49 user nova-compute[75113]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c, portal: 172.16.0.220,3260] successful.
Oct 26 17:18:49 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a77e10d2-6a5d-4f5a-b37a-bfc05e92453c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8244e07f-b54d-479a-9347-7c15bcb7f441]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] <== disconnect_volume: return (305ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:18:49 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Deleting instance files /opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e_del
Oct 26 17:18:49 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Deletion of /opt/stack/data/nova/instances/9593d2bd-4eaf-4cc6-a3ab-8766f769d32e_del complete
Oct 26 17:18:49 user nova-compute[75113]: INFO nova.compute.manager [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 26 17:18:49 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:18:49 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:18:49 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Took 0.41 seconds to deallocate network for instance.
Oct 26 17:18:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-ad29b170-0a37-4bdd-97cb-a9643b604593 req-7ba298d6-2905-4268-9e54-8fee44bce3e0 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ad29b170-0a37-4bdd-97cb-a9643b604593 req-7ba298d6-2905-4268-9e54-8fee44bce3e0 service nova] Acquiring lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ad29b170-0a37-4bdd-97cb-a9643b604593 req-7ba298d6-2905-4268-9e54-8fee44bce3e0 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ad29b170-0a37-4bdd-97cb-a9643b604593 req-7ba298d6-2905-4268-9e54-8fee44bce3e0 service nova] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-ad29b170-0a37-4bdd-97cb-a9643b604593 req-7ba298d6-2905-4268-9e54-8fee44bce3e0 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] No waiting events found dispatching network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:18:50 user nova-compute[75113]: WARNING nova.compute.manager [req-ad29b170-0a37-4bdd-97cb-a9643b604593 req-7ba298d6-2905-4268-9e54-8fee44bce3e0 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received unexpected event network-vif-plugged-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 for instance with vm_state active and task_state deleting.
Oct 26 17:18:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-ad29b170-0a37-4bdd-97cb-a9643b604593 req-7ba298d6-2905-4268-9e54-8fee44bce3e0 service nova] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Received event network-vif-deleted-2f8541b1-74e9-4dd3-ad25-bcf31b21f605 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:18:51 user nova-compute[75113]: INFO nova.compute.manager [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e] Took 1.06 seconds to detach 1 volumes for instance.
Oct 26 17:18:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:18:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:18:51 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:18:51 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.volume.cinder [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Update attachment failed for attachment 2c9ee09b-b529-4d62-812f-b925c6500bed. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ba81f03d-e1bc-4488-9c2c-3f77270e7125) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ba81f03d-e1bc-4488-9c2c-3f77270e7125)
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Failed to attach 1288c48e-5db1-453e-96b2-51be0b509118 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ba81f03d-e1bc-4488-9c2c-3f77270e7125)
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Traceback (most recent call last):
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     ret_val = method(obj, context, *args, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     self._do_attach(context, instance, volume, volume_api,
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     self._volume_attach(context, volume, connector, instance,
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     connection_info = volume_api.attachment_update(
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     res = method(self, ctx, *args, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     with excutils.save_and_reraise_exception():
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     self.force_reraise()
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     raise self.value
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     return method.func(obj, *args, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     resp = self._update('/attachments/%s' % id, body)
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     return self.request(url, method, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023]     raise exceptions.from_response(resp, body)
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ba81f03d-e1bc-4488-9c2c-3f77270e7125)
Oct 26 17:18:51 user nova-compute[75113]: ERROR nova.compute.manager [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] 
Oct 26 17:18:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:51 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Deleted allocations for instance 9593d2bd-4eaf-4cc6-a3ab-8766f769d32e
Oct 26 17:18:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.162s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f455809c-9ee8-4cbf-8b34-ddae297d9b62 tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "9593d2bd-4eaf-4cc6-a3ab-8766f769d32e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.256s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server [None req-4a48d1fd-b186-48ec-9438-5fe6063aa7e7 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ba81f03d-e1bc-4488-9c2c-3f77270e7125)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ba81f03d-e1bc-4488-9c2c-3f77270e7125)
Oct 26 17:18:51 user nova-compute[75113]: ERROR oslo_messaging.rpc.server 
Oct 26 17:18:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:18:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:10 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:19:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG nova.compute.manager [req-0ade45c9-1eaf-4f46-a3aa-058cd064237d req-56eb1ae6-01ed-4982-accd-b5e1d0dacbfd service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Received event network-changed-9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG nova.compute.manager [req-0ade45c9-1eaf-4f46-a3aa-058cd064237d req-56eb1ae6-01ed-4982-accd-b5e1d0dacbfd service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Refreshing instance network info cache due to event network-changed-9c8d391d-ef18-4deb-9312-f9667d6362ea. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0ade45c9-1eaf-4f46-a3aa-058cd064237d req-56eb1ae6-01ed-4982-accd-b5e1d0dacbfd service nova] Acquiring lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0ade45c9-1eaf-4f46-a3aa-058cd064237d req-56eb1ae6-01ed-4982-accd-b5e1d0dacbfd service nova] Acquired lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:19:15 user nova-compute[75113]: DEBUG nova.network.neutron [req-0ade45c9-1eaf-4f46-a3aa-058cd064237d req-56eb1ae6-01ed-4982-accd-b5e1d0dacbfd service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Refreshing network info cache for port 9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG nova.network.neutron [req-0ade45c9-1eaf-4f46-a3aa-058cd064237d req-56eb1ae6-01ed-4982-accd-b5e1d0dacbfd service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updated VIF entry in instance network info cache for port 9c8d391d-ef18-4deb-9312-f9667d6362ea. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG nova.network.neutron [req-0ade45c9-1eaf-4f46-a3aa-058cd064237d req-56eb1ae6-01ed-4982-accd-b5e1d0dacbfd service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updating instance_info_cache with network_info: [{"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0ade45c9-1eaf-4f46-a3aa-058cd064237d req-56eb1ae6-01ed-4982-accd-b5e1d0dacbfd service nova] Releasing lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG nova.objects.instance [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lazy-loading 'flavor' on Instance uuid fc80403d-8fbd-4836-8d01-89fa7aad8d7e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:16 user nova-compute[75113]: INFO nova.compute.manager [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Attaching volume 87e43785-13b9-43d2-b93f-1b175407c7a7 to /dev/vdb
Oct 26 17:19:16 user nova-compute[75113]: DEBUG os_brick.utils [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[550b00d0-8bd4-43c7-95ad-850cd6c6eb3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7a817f-a8b0-4929-9f9e-6a0ed3574e52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbaac06-ddf7-4b6a-b6dd-0e8c4b0100eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[165a4ce4-a575-4826-af57-621bded34219]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:19:16 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d569887e-2b9e-4574-9b22-618f69ae753d]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG os_brick.utils [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updating existing volume attachment record: 3478fd6f-b788-4524-8a38-cebbd4532f6c {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:19:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:17 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:19:17 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:19:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8225MB free_disk=25.03741455078125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 04f0351c-6347-4353-bc70-ffa74158496c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e216e427-7231-4491-85f8-607c930e0d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 8ef579e4-167c-42cf-bd7a-65d9862f5023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:19:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:18 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:19:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:20 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:19:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:19:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 17:19:20 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:19:20 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:19:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:19:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:19:23 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:19:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:31 user nova-compute[75113]: INFO nova.compute.manager [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Terminating instance
Oct 26 17:19:31 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG nova.compute.manager [req-f57b279a-699b-47d7-86ce-e39a337e1ab7 req-7583d93a-97b0-41f0-9b59-2a0a1a49294c service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-unplugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f57b279a-699b-47d7-86ce-e39a337e1ab7 req-7583d93a-97b0-41f0-9b59-2a0a1a49294c service nova] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f57b279a-699b-47d7-86ce-e39a337e1ab7 req-7583d93a-97b0-41f0-9b59-2a0a1a49294c service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f57b279a-699b-47d7-86ce-e39a337e1ab7 req-7583d93a-97b0-41f0-9b59-2a0a1a49294c service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG nova.compute.manager [req-f57b279a-699b-47d7-86ce-e39a337e1ab7 req-7583d93a-97b0-41f0-9b59-2a0a1a49294c service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] No waiting events found dispatching network-vif-unplugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:19:31 user nova-compute[75113]: DEBUG nova.compute.manager [req-f57b279a-699b-47d7-86ce-e39a337e1ab7 req-7583d93a-97b0-41f0-9b59-2a0a1a49294c service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-unplugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:32 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: e216e427-7231-4491-85f8-607c930e0d43] Instance destroyed successfully.
Oct 26 17:19:32 user nova-compute[75113]: DEBUG nova.objects.instance [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'resources' on Instance uuid e216e427-7231-4491-85f8-607c930e0d43 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1800361624',display_name='tempest-AttachVolumeTestJSON-server-1800361624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1800361624',id=30,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM0mtS1dljg4Qu1gGqqTeuT9mq/sIHwVu/5XUkXKrM/OqcCuxLS9BGabMHGaDAN2pPR3pksc+bfFVi23MZQGdlYQu9QfNjCvEVQbShJMteVLFo3IenVFiQim0F4GoqwcQ==',key_name='tempest-keypair-618389938',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecfe1e4023f641d6b492c7a0d0fc033b',ramdisk_id='',reservation_id='r-hj3gqi9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1430222675',owner_user_name='tempest-AttachVolumeTestJSON-1430222675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:17:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b04592754c6c406e9d550e9036fe9ea7',uuid=e216e427-7231-4491-85f8-607c930e0d43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converting VIF {"id": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "address": "fa:16:3e:d6:32:fd", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4b54e0-28", "ovs_interfaceid": "ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG os_vif [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab4b54e0-28, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d82167eb-a4fb-4f50-bba8-1dcf6996f481) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:32 user nova-compute[75113]: INFO os_vif [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4b54e0-28')
Oct 26 17:19:32 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Deleting instance files /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43_del
Oct 26 17:19:32 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Deletion of /opt/stack/data/nova/instances/e216e427-7231-4491-85f8-607c930e0d43_del complete
Oct 26 17:19:32 user nova-compute[75113]: INFO nova.compute.manager [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: e216e427-7231-4491-85f8-607c930e0d43] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 17:19:32 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: e216e427-7231-4491-85f8-607c930e0d43] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:19:32 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: e216e427-7231-4491-85f8-607c930e0d43] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:19:33 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: e216e427-7231-4491-85f8-607c930e0d43] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:19:33 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: e216e427-7231-4491-85f8-607c930e0d43] Took 0.82 seconds to deallocate network for instance.
Oct 26 17:19:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:33 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:19:33 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:19:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:33 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Deleted allocations for instance e216e427-7231-4491-85f8-607c930e0d43
Oct 26 17:19:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8ddeeb60-66a0-4985-889e-15d21d3a0f8e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "e216e427-7231-4491-85f8-607c930e0d43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.135s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-398f1fbf-e31f-4617-ba31-5fc510a6b4d6 req-305d2245-f17a-470b-bda8-aae48bf45ee6 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-398f1fbf-e31f-4617-ba31-5fc510a6b4d6 req-305d2245-f17a-470b-bda8-aae48bf45ee6 service nova] Acquiring lock "e216e427-7231-4491-85f8-607c930e0d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-398f1fbf-e31f-4617-ba31-5fc510a6b4d6 req-305d2245-f17a-470b-bda8-aae48bf45ee6 service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-398f1fbf-e31f-4617-ba31-5fc510a6b4d6 req-305d2245-f17a-470b-bda8-aae48bf45ee6 service nova] Lock "e216e427-7231-4491-85f8-607c930e0d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-398f1fbf-e31f-4617-ba31-5fc510a6b4d6 req-305d2245-f17a-470b-bda8-aae48bf45ee6 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] No waiting events found dispatching network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:19:33 user nova-compute[75113]: WARNING nova.compute.manager [req-398f1fbf-e31f-4617-ba31-5fc510a6b4d6 req-305d2245-f17a-470b-bda8-aae48bf45ee6 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received unexpected event network-vif-plugged-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 for instance with vm_state deleted and task_state None.
Oct 26 17:19:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-398f1fbf-e31f-4617-ba31-5fc510a6b4d6 req-305d2245-f17a-470b-bda8-aae48bf45ee6 service nova] [instance: e216e427-7231-4491-85f8-607c930e0d43] Received event network-vif-deleted-ab4b54e0-28e1-425c-a4d3-d6c4e170d7a8 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVDpMtmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:19:34 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:19:34 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:19:34 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d1a8cb-18e6-4bf4-9e68-66114eaba2a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:19:34 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9c0155-f590-44db-9754-fbb58a25e0b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7] added
Oct 26 17:19:34 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca72804c-b6cb-4234-86e6-c13248f8116f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[104bc8bc-c18f-46ae-a39f-073afaffffbe]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVDpMtmr {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVDpMtmr" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[465aa084-ebbc-49fc-8ff9-a03097319dff]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BVDpMtmr'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7166786-5c50-47b0-a49a-4aa76f20a73f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada29269-ccf7-4544-838a-c9b251a29c67]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:19:34 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:19:34 user nova-compute[75113]:  {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:19:34 user nova-compute[75113]: WARNING os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 17:19:34 user nova-compute[75113]: 
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aa6bbf-8e51-475c-98f4-5554dc0250bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7, portal: 172.16.0.220,3260]
Oct 26 17:19:34 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7, portal: 172.16.0.220,3260] successful.
Oct 26 17:19:34 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dc5e3f-f84a-4c5c-9a66-ec199c53cfd0]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecb246c-be90-4c59-9efe-12f08e137c00]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 (non-flash)
Oct 26 17:19:34 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 (non-flash)
Oct 26 17:19:34 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbabe16f-d8af-48c5-8759-100932742c6b]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:34 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:19:35 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:19:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVDpMtmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:19:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:19:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23865343462333631', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:19:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865343462333631', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:19:35 user nova-compute[75113]: DEBUG nova.objects.instance [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lazy-loading 'flavor' on Instance uuid fc80403d-8fbd-4836-8d01-89fa7aad8d7e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:19:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:19:35 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:19:35 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:19:35 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:19:35 user nova-compute[75113]:   <serial>87e43785-13b9-43d2-b93f-1b175407c7a7</serial>
Oct 26 17:19:35 user nova-compute[75113]: </disk>
Oct 26 17:19:35 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:19:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:19:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:19:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] No VIF found with MAC fa:16:3e:b4:37:33, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:19:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f004e51-c962-4e33-9d17-b6fb7175b0cc tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.732s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:38 user nova-compute[75113]: INFO nova.compute.manager [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Detaching volume 87e43785-13b9-43d2-b93f-1b175407c7a7
Oct 26 17:19:38 user nova-compute[75113]: INFO nova.virt.block_device [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Attempting to driver detach volume 87e43785-13b9-43d2-b93f-1b175407c7a7 from mountpoint /dev/vdb
Oct 26 17:19:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Attempting to detach device vdb from instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:19:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:19:38 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:19:38 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:19:38 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:19:38 user nova-compute[75113]:   <serial>87e43785-13b9-43d2-b93f-1b175407c7a7</serial>
Oct 26 17:19:38 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:19:38 user nova-compute[75113]: </disk>
Oct 26 17:19:38 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:19:38 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Successfully detached device vdb from instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e from the persistent domain config.
Oct 26 17:19:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:19:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:19:38 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:19:38 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:19:38 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:19:38 user nova-compute[75113]:   <serial>87e43785-13b9-43d2-b93f-1b175407c7a7</serial>
Oct 26 17:19:38 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:19:38 user nova-compute[75113]: </disk>
Oct 26 17:19:38 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "04f0351c-6347-4353-bc70-ffa74158496c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "04f0351c-6347-4353-bc70-ffa74158496c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "04f0351c-6347-4353-bc70-ffa74158496c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "04f0351c-6347-4353-bc70-ffa74158496c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "04f0351c-6347-4353-bc70-ffa74158496c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:39 user nova-compute[75113]: INFO nova.compute.manager [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Terminating instance
Oct 26 17:19:39 user nova-compute[75113]: DEBUG nova.compute.manager [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-19bd0e45-588e-48b5-90f1-3e2606e482ac req-45b2c037-41d3-4e78-829f-8fe5aa6c0a45 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Received event network-vif-unplugged-de147975-aa0e-4028-af5f-a92993f17b8f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-19bd0e45-588e-48b5-90f1-3e2606e482ac req-45b2c037-41d3-4e78-829f-8fe5aa6c0a45 service nova] Acquiring lock "04f0351c-6347-4353-bc70-ffa74158496c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-19bd0e45-588e-48b5-90f1-3e2606e482ac req-45b2c037-41d3-4e78-829f-8fe5aa6c0a45 service nova] Lock "04f0351c-6347-4353-bc70-ffa74158496c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-19bd0e45-588e-48b5-90f1-3e2606e482ac req-45b2c037-41d3-4e78-829f-8fe5aa6c0a45 service nova] Lock "04f0351c-6347-4353-bc70-ffa74158496c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-19bd0e45-588e-48b5-90f1-3e2606e482ac req-45b2c037-41d3-4e78-829f-8fe5aa6c0a45 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] No waiting events found dispatching network-vif-unplugged-de147975-aa0e-4028-af5f-a92993f17b8f {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-19bd0e45-588e-48b5-90f1-3e2606e482ac req-45b2c037-41d3-4e78-829f-8fe5aa6c0a45 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Received event network-vif-unplugged-de147975-aa0e-4028-af5f-a92993f17b8f for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:39 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Instance destroyed successfully.
Oct 26 17:19:39 user nova-compute[75113]: DEBUG nova.objects.instance [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lazy-loading 'resources' on Instance uuid 04f0351c-6347-4353-bc70-ffa74158496c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1334981408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1334981408',id=13,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:58:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae5d124cb054dfbbe04433a685903bc',ramdisk_id='',reservation_id='r-sqaq5djn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:00:17Z,user_data=None,user_id='c431350f06fd4dbf8d74835f34626ee7',uuid=04f0351c-6347-4353-bc70-ffa74158496c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de147975-aa0e-4028-af5f-a92993f17b8f", "address": "fa:16:3e:47:99:24", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde147975-aa", "ovs_interfaceid": "de147975-aa0e-4028-af5f-a92993f17b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converting VIF {"id": "de147975-aa0e-4028-af5f-a92993f17b8f", "address": "fa:16:3e:47:99:24", "network": {"id": "9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-122101673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5d124cb054dfbbe04433a685903bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde147975-aa", "ovs_interfaceid": "de147975-aa0e-4028-af5f-a92993f17b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:99:24,bridge_name='br-int',has_traffic_filtering=True,id=de147975-aa0e-4028-af5f-a92993f17b8f,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde147975-aa') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG os_vif [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:99:24,bridge_name='br-int',has_traffic_filtering=True,id=de147975-aa0e-4028-af5f-a92993f17b8f,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde147975-aa') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde147975-aa, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=451d51cf-5297-4dce-8ac8-caaac67dc91a) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:39 user nova-compute[75113]: INFO os_vif [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:99:24,bridge_name='br-int',has_traffic_filtering=True,id=de147975-aa0e-4028-af5f-a92993f17b8f,network=Network(9afb93fa-c6c3-4d31-9e42-0ebb13e17cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde147975-aa')
Oct 26 17:19:39 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Deleting instance files /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c_del
Oct 26 17:19:39 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Deletion of /opt/stack/data/nova/instances/04f0351c-6347-4353-bc70-ffa74158496c_del complete
Oct 26 17:19:39 user nova-compute[75113]: INFO nova.compute.manager [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 26 17:19:39 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:19:39 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:19:40 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:19:40 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Took 0.42 seconds to deallocate network for instance.
Oct 26 17:19:40 user nova-compute[75113]: DEBUG nova.compute.manager [req-287da7cc-523a-4e1a-938a-6ace0ec36431 req-0ad1f7d6-7cda-4496-ba48-e7b6be7082ad service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Received event network-vif-deleted-de147975-aa0e-4028-af5f-a92993f17b8f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:40 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:19:40 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:19:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:40 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Deleted allocations for instance 04f0351c-6347-4353-bc70-ffa74158496c
Oct 26 17:19:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b35b780-54b4-4f5d-8b16-583039e0e2ac tempest-ServerBootFromVolumeStableRescueTest-2080298495 tempest-ServerBootFromVolumeStableRescueTest-2080298495-project-member] Lock "04f0351c-6347-4353-bc70-ffa74158496c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.548s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-1eb0b0be-dc01-45e7-8c85-026269ba9c50 req-e53a479a-1137-44da-b41d-9b9dd01fbd98 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Received event network-vif-plugged-de147975-aa0e-4028-af5f-a92993f17b8f {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1eb0b0be-dc01-45e7-8c85-026269ba9c50 req-e53a479a-1137-44da-b41d-9b9dd01fbd98 service nova] Acquiring lock "04f0351c-6347-4353-bc70-ffa74158496c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1eb0b0be-dc01-45e7-8c85-026269ba9c50 req-e53a479a-1137-44da-b41d-9b9dd01fbd98 service nova] Lock "04f0351c-6347-4353-bc70-ffa74158496c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1eb0b0be-dc01-45e7-8c85-026269ba9c50 req-e53a479a-1137-44da-b41d-9b9dd01fbd98 service nova] Lock "04f0351c-6347-4353-bc70-ffa74158496c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-1eb0b0be-dc01-45e7-8c85-026269ba9c50 req-e53a479a-1137-44da-b41d-9b9dd01fbd98 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] No waiting events found dispatching network-vif-plugged-de147975-aa0e-4028-af5f-a92993f17b8f {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:19:41 user nova-compute[75113]: WARNING nova.compute.manager [req-1eb0b0be-dc01-45e7-8c85-026269ba9c50 req-e53a479a-1137-44da-b41d-9b9dd01fbd98 service nova] [instance: 04f0351c-6347-4353-bc70-ffa74158496c] Received unexpected event network-vif-plugged-de147975-aa0e-4028-af5f-a92993f17b8f for instance with vm_state deleted and task_state None.
Oct 26 17:19:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:48 user nova-compute[75113]: INFO nova.compute.manager [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Terminating instance
Oct 26 17:19:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-c05d57a0-25c8-4013-9544-4b99eeefa6ac req-b8add90c-dd7e-48a5-91d3-4ec0bfbda117 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-unplugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c05d57a0-25c8-4013-9544-4b99eeefa6ac req-b8add90c-dd7e-48a5-91d3-4ec0bfbda117 service nova] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c05d57a0-25c8-4013-9544-4b99eeefa6ac req-b8add90c-dd7e-48a5-91d3-4ec0bfbda117 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c05d57a0-25c8-4013-9544-4b99eeefa6ac req-b8add90c-dd7e-48a5-91d3-4ec0bfbda117 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-c05d57a0-25c8-4013-9544-4b99eeefa6ac req-b8add90c-dd7e-48a5-91d3-4ec0bfbda117 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] No waiting events found dispatching network-vif-unplugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:19:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-c05d57a0-25c8-4013-9544-4b99eeefa6ac req-b8add90c-dd7e-48a5-91d3-4ec0bfbda117 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-unplugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:49 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Instance destroyed successfully.
Oct 26 17:19:49 user nova-compute[75113]: DEBUG nova.objects.instance [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'resources' on Instance uuid 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1323343316',display_name='tempest-ServerRescueNegativeTestJSON-server-1323343316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1323343316',id=24,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:05:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d11c5d88b2f4a45acee2e9c7d26043a',ramdisk_id='',reservation_id='r-oxsm407w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760587308',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760587308-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:05:02Z,user_data=None,user_id='5aa8e21aab014ce6ace0109878275b8f',uuid=5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converting VIF {"id": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "address": "fa:16:3e:00:a6:36", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fed87a-c8", "ovs_interfaceid": "03fed87a-c881-4ca6-85a3-4440a97ddd8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=03fed87a-c881-4ca6-85a3-4440a97ddd8c,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fed87a-c8') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG os_vif [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=03fed87a-c881-4ca6-85a3-4440a97ddd8c,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fed87a-c8') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03fed87a-c8, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea956851-3f33-4071-b529-3e8b0833e359) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:49 user nova-compute[75113]: INFO os_vif [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=03fed87a-c881-4ca6-85a3-4440a97ddd8c,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fed87a-c8')
Oct 26 17:19:49 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Deleting instance files /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88_del
Oct 26 17:19:49 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Deletion of /opt/stack/data/nova/instances/5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88_del complete
Oct 26 17:19:49 user nova-compute[75113]: INFO nova.compute.manager [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 26 17:19:49 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:19:49 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Took 0.54 seconds to deallocate network for instance.
Oct 26 17:19:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-662203b1-dbc8-4d0d-b0a4-2c1dd09b3713 req-cbdc0751-cf61-4d1c-8ed4-9a5dba19f5c8 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-deleted-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:19:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:50 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Deleted allocations for instance 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d1479515-1e4b-4da7-b742-0b73142d273d tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.868s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] No waiting events found dispatching network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:19:50 user nova-compute[75113]: WARNING nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received unexpected event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c for instance with vm_state deleted and task_state None.
Oct 26 17:19:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] No waiting events found dispatching network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:19:50 user nova-compute[75113]: WARNING nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received unexpected event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c for instance with vm_state deleted and task_state None.
Oct 26 17:19:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] No waiting events found dispatching network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:19:50 user nova-compute[75113]: WARNING nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received unexpected event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c for instance with vm_state deleted and task_state None.
Oct 26 17:19:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-unplugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] No waiting events found dispatching network-vif-unplugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:19:50 user nova-compute[75113]: WARNING nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received unexpected event network-vif-unplugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c for instance with vm_state deleted and task_state None.
Oct 26 17:19:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Acquiring lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] Lock "5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:19:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] No waiting events found dispatching network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:19:50 user nova-compute[75113]: WARNING nova.compute.manager [req-e1341307-48c3-41b9-b156-4a2972be8a0d req-fc70a5d0-3866-4e5e-b0b9-5a3d7ebe21e2 service nova] [instance: 5afc92a3-ddc9-4ba4-a1f0-6eafd76ddd88] Received unexpected event network-vif-plugged-03fed87a-c881-4ca6-85a3-4440a97ddd8c for instance with vm_state deleted and task_state None.
Oct 26 17:19:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:19:59 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e is timed out.
Oct 26 17:19:59 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Successfully detached device vdb from instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e from the live domain config.
Oct 26 17:19:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVDpMtmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:19:59 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c11eedb-d270-40c4-8537-89692c74b81a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:19:59 user nova-compute[75113]: No targets found.
Oct 26 17:19:59 user nova-compute[75113]: iSNS:
Oct 26 17:19:59 user nova-compute[75113]: No targets found.
Oct 26 17:19:59 user nova-compute[75113]: STATIC:
Oct 26 17:19:59 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7
Oct 26 17:19:59 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:19:59 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:19:59 user nova-compute[75113]: FIRMWARE:
Oct 26 17:19:59 user nova-compute[75113]: No targets found.
Oct 26 17:19:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:19:59 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:19:59 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce22b27f-138e-4adb-ade8-9bd0feba3171]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8b8554-9c88-4335-9ccb-115fc622f3c8]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 (non-flash)
Oct 26 17:19:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 (non-flash)
Oct 26 17:19:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49143da050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4060c389-fd0e-46a8-8053-3f07633813dd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79795b5-a5e1-490e-b2e7-8fcb61964ea2]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e65c77-6403-4648-b6e7-8a8267dade9e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad2d671-9e1a-4e66-98f3-e0911c29447d]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[238bd907-ac6c-4f96-a380-b9ab564f642e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dbb5de-e5ae-4af4-b452-a61c1f9ccbab]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7, portal: 172.16.0.220,3260]
Oct 26 17:19:59 user nova-compute[75113]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7, portal: 172.16.0.220,3260] successful.
Oct 26 17:19:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e43785-13b9-43d2-b93f-1b175407c7a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a04dd0-5695-4eba-91e0-4b531f554e39]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] <== disconnect_volume: return (289ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:19:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:20:00 user nova-compute[75113]: DEBUG nova.objects.instance [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lazy-loading 'flavor' on Instance uuid fc80403d-8fbd-4836-8d01-89fa7aad8d7e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:20:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-beb7639d-f826-462f-9beb-188624a3c4c0 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.734s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:20:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:20:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:20:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:20:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:12 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:20:15 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:15 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:15 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:20:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:16 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:16 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:20:16 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:20:16 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8562MB free_disk=25.20842742919922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:20:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:20:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 8ef579e4-167c-42cf-bd7a-65d9862f5023 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:20:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:20:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:20:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:20:17 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:20:17 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:20:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:20:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:17 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:17 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 17:20:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:20:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:20:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:20:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:20:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:23 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:20:23 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:20:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:20:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:20:23 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:20:23 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:20:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:24 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Updating instance_info_cache with network_info: [{"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:20:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:20:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:20:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:20:26 user nova-compute[75113]: INFO nova.compute.claims [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Claim successful on node user
Oct 26 17:20:26 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Refreshing inventories for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Updating ProviderTree inventory for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Updating inventory in ProviderTree for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Refreshing aggregate associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, aggregates: None {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Refreshing trait associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:20:26 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:20:26 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:20:26 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG nova.policy [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b04592754c6c406e9d550e9036fe9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfe1e4023f641d6b492c7a0d0fc033b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:20:27 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Creating image(s)
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "/opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "/opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "/opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk 1073741824" returned: 0 in 0.052s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Successfully created port: 991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Cannot resize image /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Ensure instance console log exists: /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Successfully updated port: 991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "refresh_cache-183f0ea9-141a-4df8-98c9-db68420a5bbe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquired lock "refresh_cache-183f0ea9-141a-4df8-98c9-db68420a5bbe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-2348f7d8-1b15-484f-ac02-fada1340f370 req-20e63205-dbc3-47eb-b6a2-6f7ad2d6738a service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Received event network-changed-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-2348f7d8-1b15-484f-ac02-fada1340f370 req-20e63205-dbc3-47eb-b6a2-6f7ad2d6738a service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Refreshing instance network info cache due to event network-changed-991d39e0-d395-48e6-b6d9-e1d9868b1ca9. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2348f7d8-1b15-484f-ac02-fada1340f370 req-20e63205-dbc3-47eb-b6a2-6f7ad2d6738a service nova] Acquiring lock "refresh_cache-183f0ea9-141a-4df8-98c9-db68420a5bbe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Updating instance_info_cache with network_info: [{"id": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "address": "fa:16:3e:2e:29:e3", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991d39e0-d3", "ovs_interfaceid": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Releasing lock "refresh_cache-183f0ea9-141a-4df8-98c9-db68420a5bbe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Instance network_info: |[{"id": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "address": "fa:16:3e:2e:29:e3", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991d39e0-d3", "ovs_interfaceid": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2348f7d8-1b15-484f-ac02-fada1340f370 req-20e63205-dbc3-47eb-b6a2-6f7ad2d6738a service nova] Acquired lock "refresh_cache-183f0ea9-141a-4df8-98c9-db68420a5bbe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.network.neutron [req-2348f7d8-1b15-484f-ac02-fada1340f370 req-20e63205-dbc3-47eb-b6a2-6f7ad2d6738a service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Refreshing network info cache for port 991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Start _get_guest_xml network_info=[{"id": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "address": "fa:16:3e:2e:29:e3", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991d39e0-d3", "ovs_interfaceid": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:20:28 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:20:28 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:20:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-956791486',display_name='tempest-AttachVolumeTestJSON-server-956791486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-956791486',id=37,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzuE0QRAOClk/XLrbiky/zYfzFPJqi/Mrqof0qDhomsUhbOBsynBWDa5TcfrPpub67EtcN7dC3d6Xlacw58LRYxs7vkCYnlQwcl2eB16y2MVn/imZ+ww5+hPbR0kjBVvw==',key_name='tempest-keypair-1320210309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecfe1e4023f641d6b492c7a0d0fc033b',ramdisk_id='',reservation_id='r-3g60m8aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1430222675',owner_user_name='tempest-AttachVolumeTestJSON-1430222675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:20:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b04592754c6c406e9d550e9036fe9ea7',uuid=183f0ea9-141a-4df8-98c9-db68420a5bbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "address": "fa:16:3e:2e:29:e3", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991d39e0-d3", "ovs_interfaceid": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converting VIF {"id": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "address": "fa:16:3e:2e:29:e3", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991d39e0-d3", "ovs_interfaceid": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:29:e3,bridge_name='br-int',has_traffic_filtering=True,id=991d39e0-d395-48e6-b6d9-e1d9868b1ca9,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991d39e0-d3') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'pci_devices' on Instance uuid 183f0ea9-141a-4df8-98c9-db68420a5bbe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:20:28 user nova-compute[75113]:   <uuid>183f0ea9-141a-4df8-98c9-db68420a5bbe</uuid>
Oct 26 17:20:28 user nova-compute[75113]:   <name>instance-00000025</name>
Oct 26 17:20:28 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:20:28 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:20:28 user nova-compute[75113]:   <metadata>
Oct 26 17:20:28 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:20:28 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:20:28 user nova-compute[75113]:       <nova:name>tempest-AttachVolumeTestJSON-server-956791486</nova:name>
Oct 26 17:20:28 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:20:28</nova:creationTime>
Oct 26 17:20:28 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:20:28 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:20:28 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:20:28 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:20:28 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:20:28 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:20:28 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:20:28 user nova-compute[75113]:       <nova:owner>
Oct 26 17:20:28 user nova-compute[75113]:         <nova:user uuid="b04592754c6c406e9d550e9036fe9ea7">tempest-AttachVolumeTestJSON-1430222675-project-member</nova:user>
Oct 26 17:20:28 user nova-compute[75113]:         <nova:project uuid="ecfe1e4023f641d6b492c7a0d0fc033b">tempest-AttachVolumeTestJSON-1430222675</nova:project>
Oct 26 17:20:28 user nova-compute[75113]:       </nova:owner>
Oct 26 17:20:28 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:20:28 user nova-compute[75113]:       <nova:ports>
Oct 26 17:20:28 user nova-compute[75113]:         <nova:port uuid="991d39e0-d395-48e6-b6d9-e1d9868b1ca9">
Oct 26 17:20:28 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 17:20:28 user nova-compute[75113]:         </nova:port>
Oct 26 17:20:28 user nova-compute[75113]:       </nova:ports>
Oct 26 17:20:28 user nova-compute[75113]:     </nova:instance>
Oct 26 17:20:28 user nova-compute[75113]:   </metadata>
Oct 26 17:20:28 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:20:28 user nova-compute[75113]:     <system>
Oct 26 17:20:28 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:20:28 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:20:28 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:20:28 user nova-compute[75113]:       <entry name="serial">183f0ea9-141a-4df8-98c9-db68420a5bbe</entry>
Oct 26 17:20:28 user nova-compute[75113]:       <entry name="uuid">183f0ea9-141a-4df8-98c9-db68420a5bbe</entry>
Oct 26 17:20:28 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:20:28 user nova-compute[75113]:     </system>
Oct 26 17:20:28 user nova-compute[75113]:   </sysinfo>
Oct 26 17:20:28 user nova-compute[75113]:   <os>
Oct 26 17:20:28 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:20:28 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:20:28 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:20:28 user nova-compute[75113]:   </os>
Oct 26 17:20:28 user nova-compute[75113]:   <features>
Oct 26 17:20:28 user nova-compute[75113]:     <acpi/>
Oct 26 17:20:28 user nova-compute[75113]:     <apic/>
Oct 26 17:20:28 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:20:28 user nova-compute[75113]:   </features>
Oct 26 17:20:28 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:20:28 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:20:28 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:20:28 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:20:28 user nova-compute[75113]:   </clock>
Oct 26 17:20:28 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:20:28 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:20:28 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:20:28 user nova-compute[75113]:   </cpu>
Oct 26 17:20:28 user nova-compute[75113]:   <devices>
Oct 26 17:20:28 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:20:28 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:20:28 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk"/>
Oct 26 17:20:28 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:20:28 user nova-compute[75113]:     </disk>
Oct 26 17:20:28 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:20:28 user nova-compute[75113]:       <mac address="fa:16:3e:2e:29:e3"/>
Oct 26 17:20:28 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:20:28 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:20:28 user nova-compute[75113]:       <target dev="tap991d39e0-d3"/>
Oct 26 17:20:28 user nova-compute[75113]:     </interface>
Oct 26 17:20:28 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:20:28 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/console.log" append="off"/>
Oct 26 17:20:28 user nova-compute[75113]:     </serial>
Oct 26 17:20:28 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:20:28 user nova-compute[75113]:     <video>
Oct 26 17:20:28 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:20:28 user nova-compute[75113]:     </video>
Oct 26 17:20:28 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:20:28 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:20:28 user nova-compute[75113]:     </rng>
Oct 26 17:20:28 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:20:28 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:20:28 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:20:28 user nova-compute[75113]:     </memballoon>
Oct 26 17:20:28 user nova-compute[75113]:   </devices>
Oct 26 17:20:28 user nova-compute[75113]: </domain>
Oct 26 17:20:28 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:20:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-956791486',display_name='tempest-AttachVolumeTestJSON-server-956791486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-956791486',id=37,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzuE0QRAOClk/XLrbiky/zYfzFPJqi/Mrqof0qDhomsUhbOBsynBWDa5TcfrPpub67EtcN7dC3d6Xlacw58LRYxs7vkCYnlQwcl2eB16y2MVn/imZ+ww5+hPbR0kjBVvw==',key_name='tempest-keypair-1320210309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecfe1e4023f641d6b492c7a0d0fc033b',ramdisk_id='',reservation_id='r-3g60m8aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1430222675',owner_user_name='tempest-AttachVolumeTestJSON-1430222675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:20:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b04592754c6c406e9d550e9036fe9ea7',uuid=183f0ea9-141a-4df8-98c9-db68420a5bbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "address": "fa:16:3e:2e:29:e3", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991d39e0-d3", "ovs_interfaceid": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converting VIF {"id": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "address": "fa:16:3e:2e:29:e3", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991d39e0-d3", "ovs_interfaceid": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:29:e3,bridge_name='br-int',has_traffic_filtering=True,id=991d39e0-d395-48e6-b6d9-e1d9868b1ca9,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991d39e0-d3') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG os_vif [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:29:e3,bridge_name='br-int',has_traffic_filtering=True,id=991d39e0-d395-48e6-b6d9-e1d9868b1ca9,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991d39e0-d3') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68ef1ce3-7270-5fa4-a829-ae40fa14cc86', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap991d39e0-d3, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap991d39e0-d3, col_values=(('qos', UUID('182fd31a-d3e0-427a-b759-65d573502d72')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap991d39e0-d3, col_values=(('external_ids', {'iface-id': '991d39e0-d395-48e6-b6d9-e1d9868b1ca9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:29:e3', 'vm-uuid': '183f0ea9-141a-4df8-98c9-db68420a5bbe'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:28 user nova-compute[75113]: INFO os_vif [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:29:e3,bridge_name='br-int',has_traffic_filtering=True,id=991d39e0-d395-48e6-b6d9-e1d9868b1ca9,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991d39e0-d3')
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:20:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No VIF found with MAC fa:16:3e:2e:29:e3, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:20:29 user nova-compute[75113]: DEBUG nova.network.neutron [req-2348f7d8-1b15-484f-ac02-fada1340f370 req-20e63205-dbc3-47eb-b6a2-6f7ad2d6738a service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Updated VIF entry in instance network info cache for port 991d39e0-d395-48e6-b6d9-e1d9868b1ca9. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:20:29 user nova-compute[75113]: DEBUG nova.network.neutron [req-2348f7d8-1b15-484f-ac02-fada1340f370 req-20e63205-dbc3-47eb-b6a2-6f7ad2d6738a service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Updating instance_info_cache with network_info: [{"id": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "address": "fa:16:3e:2e:29:e3", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991d39e0-d3", "ovs_interfaceid": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:20:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2348f7d8-1b15-484f-ac02-fada1340f370 req-20e63205-dbc3-47eb-b6a2-6f7ad2d6738a service nova] Releasing lock "refresh_cache-183f0ea9-141a-4df8-98c9-db68420a5bbe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:20:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-5483f8e2-725f-4db6-9c07-aa88cd175d09 req-f36513e5-a5d1-45d5-beb7-cbe257655e9c service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Received event network-vif-plugged-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5483f8e2-725f-4db6-9c07-aa88cd175d09 req-f36513e5-a5d1-45d5-beb7-cbe257655e9c service nova] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5483f8e2-725f-4db6-9c07-aa88cd175d09 req-f36513e5-a5d1-45d5-beb7-cbe257655e9c service nova] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5483f8e2-725f-4db6-9c07-aa88cd175d09 req-f36513e5-a5d1-45d5-beb7-cbe257655e9c service nova] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-5483f8e2-725f-4db6-9c07-aa88cd175d09 req-f36513e5-a5d1-45d5-beb7-cbe257655e9c service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] No waiting events found dispatching network-vif-plugged-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:20:30 user nova-compute[75113]: WARNING nova.compute.manager [req-5483f8e2-725f-4db6-9c07-aa88cd175d09 req-f36513e5-a5d1-45d5-beb7-cbe257655e9c service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Received unexpected event network-vif-plugged-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 for instance with vm_state building and task_state spawning.
Oct 26 17:20:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:32 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:20:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:20:32 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Instance spawned successfully.
Oct 26 17:20:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:20:32 user nova-compute[75113]: DEBUG nova.compute.manager [req-e4682c81-7250-4de8-90f6-aac76d06a3bc req-92ae3efa-2f3e-4fe4-a217-67ed94b102af service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Received event network-vif-plugged-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e4682c81-7250-4de8-90f6-aac76d06a3bc req-92ae3efa-2f3e-4fe4-a217-67ed94b102af service nova] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e4682c81-7250-4de8-90f6-aac76d06a3bc req-92ae3efa-2f3e-4fe4-a217-67ed94b102af service nova] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e4682c81-7250-4de8-90f6-aac76d06a3bc req-92ae3efa-2f3e-4fe4-a217-67ed94b102af service nova] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:32 user nova-compute[75113]: DEBUG nova.compute.manager [req-e4682c81-7250-4de8-90f6-aac76d06a3bc req-92ae3efa-2f3e-4fe4-a217-67ed94b102af service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] No waiting events found dispatching network-vif-plugged-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:20:32 user nova-compute[75113]: WARNING nova.compute.manager [req-e4682c81-7250-4de8-90f6-aac76d06a3bc req-92ae3efa-2f3e-4fe4-a217-67ed94b102af service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Received unexpected event network-vif-plugged-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 for instance with vm_state building and task_state spawning.
Oct 26 17:20:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:32 user nova-compute[75113]: INFO nova.compute.manager [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Took 5.63 seconds to spawn the instance on the hypervisor.
Oct 26 17:20:32 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:20:32 user nova-compute[75113]: INFO nova.compute.manager [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Took 6.58 seconds to build instance.
Oct 26 17:20:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4aea741e-c25c-4a6f-b54b-afa00878d25e tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.693s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:33 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:34 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:34 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 17:20:34 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] There are 0 instances to clean {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 17:20:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:37 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:38 user nova-compute[75113]: INFO nova.compute.manager [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Terminating instance
Oct 26 17:20:38 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:20:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-e23c0f75-ded6-4f12-b368-35b97314a026 req-300493f6-9f99-4fd2-918b-ac1da373a565 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-unplugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e23c0f75-ded6-4f12-b368-35b97314a026 req-300493f6-9f99-4fd2-918b-ac1da373a565 service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e23c0f75-ded6-4f12-b368-35b97314a026 req-300493f6-9f99-4fd2-918b-ac1da373a565 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e23c0f75-ded6-4f12-b368-35b97314a026 req-300493f6-9f99-4fd2-918b-ac1da373a565 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-e23c0f75-ded6-4f12-b368-35b97314a026 req-300493f6-9f99-4fd2-918b-ac1da373a565 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-unplugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-e23c0f75-ded6-4f12-b368-35b97314a026 req-300493f6-9f99-4fd2-918b-ac1da373a565 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-unplugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:39 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Instance destroyed successfully.
Oct 26 17:20:39 user nova-compute[75113]: DEBUG nova.objects.instance [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lazy-loading 'resources' on Instance uuid bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1018610013',display_name='tempest-ServerRescueNegativeTestJSON-server-1018610013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1018610013',id=23,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:07:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d11c5d88b2f4a45acee2e9c7d26043a',ramdisk_id='',reservation_id='r-z45ooa2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760587308',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760587308-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:09:49Z,user_data=None,user_id='5aa8e21aab014ce6ace0109878275b8f',uuid=bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converting VIF {"id": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "address": "fa:16:3e:9e:d5:a5", "network": {"id": "e2703c38-8392-43cc-b120-e9a57146906e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-745914918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d11c5d88b2f4a45acee2e9c7d26043a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5db72c5-58", "ovs_interfaceid": "a5db72c5-5814-4a7d-850b-3cc9292bf6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=a5db72c5-5814-4a7d-850b-3cc9292bf6d1,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5db72c5-58') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG os_vif [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=a5db72c5-5814-4a7d-850b-3cc9292bf6d1,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5db72c5-58') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5db72c5-58, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1da239c2-3847-4f2f-9bc8-832029f1d459) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:20:39 user nova-compute[75113]: INFO os_vif [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=a5db72c5-5814-4a7d-850b-3cc9292bf6d1,network=Network(e2703c38-8392-43cc-b120-e9a57146906e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5db72c5-58')
Oct 26 17:20:39 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Deleting instance files /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df_del
Oct 26 17:20:39 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Deletion of /opt/stack/data/nova/instances/bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df_del complete
Oct 26 17:20:39 user nova-compute[75113]: INFO nova.compute.manager [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 26 17:20:39 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:20:39 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:20:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:40 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:20:40 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Took 0.72 seconds to deallocate network for instance.
Oct 26 17:20:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:40 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:20:40 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:20:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:40 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Deleted allocations for instance bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df
Oct 26 17:20:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d4ce0fa-d4f5-4aff-ac3b-71bb217de98c tempest-ServerRescueNegativeTestJSON-1760587308 tempest-ServerRescueNegativeTestJSON-1760587308-project-member] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.046s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG nova.compute.manager [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:20:41 user nova-compute[75113]: WARNING nova.compute.manager [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state deleted and task_state None.
Oct 26 17:20:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:20:41 user nova-compute[75113]: WARNING nova.compute.manager [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state deleted and task_state None.
Oct 26 17:20:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:20:41 user nova-compute[75113]: WARNING nova.compute.manager [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state deleted and task_state None.
Oct 26 17:20:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] Acquiring lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] Lock "bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] No waiting events found dispatching network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:20:41 user nova-compute[75113]: WARNING nova.compute.manager [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received unexpected event network-vif-plugged-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 for instance with vm_state deleted and task_state None.
Oct 26 17:20:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-af1c8a42-cce9-46f3-b22f-3bdbb54e14b8 req-b6cabcb1-85e3-444d-8e66-e3cf8991c747 service nova] [instance: bbf0a6f9-c2d5-47f3-8b3f-ba0075e375df] Received event network-vif-deleted-a5db72c5-5814-4a7d-850b-3cc9292bf6d1 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:41 user nova-compute[75113]: INFO nova.compute.manager [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] instance snapshotting
Oct 26 17:20:41 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Beginning live snapshot process
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json -f qcow2 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json -f qcow2" returned: 0 in 0.219s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json -f qcow2 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json -f qcow2" returned: 0 in 0.207s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.203s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8j8x7qtl/4ef3a4eba5924c7cb0d0c730e229819f.delta 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8j8x7qtl/4ef3a4eba5924c7cb0d0c730e229819f.delta 1073741824" returned: 0 in 0.054s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 17:20:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 17:20:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 17:20:43 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 17:20:43 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 17:20:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8j8x7qtl/4ef3a4eba5924c7cb0d0c730e229819f.delta /opt/stack/data/nova/instances/snapshots/tmp8j8x7qtl/4ef3a4eba5924c7cb0d0c730e229819f {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8j8x7qtl/4ef3a4eba5924c7cb0d0c730e229819f.delta /opt/stack/data/nova/instances/snapshots/tmp8j8x7qtl/4ef3a4eba5924c7cb0d0c730e229819f" returned: 0 in 0.887s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:44 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Snapshot extracted, beginning image upload
Oct 26 17:20:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:20:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:45 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:20:45 user nova-compute[75113]: INFO nova.compute.claims [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Claim successful on node user
Oct 26 17:20:46 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:20:46 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:20:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG nova.policy [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b16af3affdf47f596f944cb83f772e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b425dca1e9645ad99fea4b666b01fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:20:46 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Creating image(s)
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "/opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "/opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "/opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.035s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.202s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.188s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk 1073741824" returned: 0 in 0.069s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Successfully created port: a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Cannot resize image /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Ensure instance console log exists: /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:47 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Snapshot image upload complete
Oct 26 17:20:47 user nova-compute[75113]: INFO nova.compute.manager [None req-11e8c897-789e-46a2-b6a6-ece5b1955ee8 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Took 6.12 seconds to snapshot the instance on the hypervisor.
Oct 26 17:20:47 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Successfully updated port: a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquired lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-3b91ab5d-e3a7-4ab8-a6b1-f1c70d07a55e req-78208061-2ee5-4979-8426-e3956167c773 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-changed-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG nova.compute.manager [req-3b91ab5d-e3a7-4ab8-a6b1-f1c70d07a55e req-78208061-2ee5-4979-8426-e3956167c773 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Refreshing instance network info cache due to event network-changed-a579d831-4c13-4c14-bb83-d0eae63bfecc. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3b91ab5d-e3a7-4ab8-a6b1-f1c70d07a55e req-78208061-2ee5-4979-8426-e3956167c773 service nova] Acquiring lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:20:47 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updating instance_info_cache with network_info: [{"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Releasing lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Instance network_info: |[{"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3b91ab5d-e3a7-4ab8-a6b1-f1c70d07a55e req-78208061-2ee5-4979-8426-e3956167c773 service nova] Acquired lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.network.neutron [req-3b91ab5d-e3a7-4ab8-a6b1-f1c70d07a55e req-78208061-2ee5-4979-8426-e3956167c773 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Refreshing network info cache for port a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Start _get_guest_xml network_info=[{"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:20:48 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:20:48 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1601727451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1601727451',id=38,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/ti9SgfZo5ZxnMZs4A1FtLos6PaWPOYvz9rLDjIoS/K8b7t1GcFvLTOt05j0mGqfEFNT1P6dHavVXrlCDiUYNXeNT+tgzbSr80cX4zrTu374SJVw79aSaRs7elSBabnA==',key_name='tempest-keypair-1190114021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b425dca1e9645ad99fea4b666b01fab',ramdisk_id='',reservation_id='r-uwmu4xiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1688117037',owner_user_name='tempest-AttachVolumeShelveTestJSON-1688117037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b16af3affdf47f596f944cb83f772e9',uuid=f642e634-0efc-4ed2-aa00-ba2d3979b353,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converting VIF {"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.objects.instance [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'pci_devices' on Instance uuid f642e634-0efc-4ed2-aa00-ba2d3979b353 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:20:48 user nova-compute[75113]:   <uuid>f642e634-0efc-4ed2-aa00-ba2d3979b353</uuid>
Oct 26 17:20:48 user nova-compute[75113]:   <name>instance-00000026</name>
Oct 26 17:20:48 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:20:48 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:20:48 user nova-compute[75113]:   <metadata>
Oct 26 17:20:48 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:20:48 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:20:48 user nova-compute[75113]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1601727451</nova:name>
Oct 26 17:20:48 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:20:48</nova:creationTime>
Oct 26 17:20:48 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:20:48 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:20:48 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:20:48 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:20:48 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:20:48 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:20:48 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:20:48 user nova-compute[75113]:       <nova:owner>
Oct 26 17:20:48 user nova-compute[75113]:         <nova:user uuid="6b16af3affdf47f596f944cb83f772e9">tempest-AttachVolumeShelveTestJSON-1688117037-project-member</nova:user>
Oct 26 17:20:48 user nova-compute[75113]:         <nova:project uuid="2b425dca1e9645ad99fea4b666b01fab">tempest-AttachVolumeShelveTestJSON-1688117037</nova:project>
Oct 26 17:20:48 user nova-compute[75113]:       </nova:owner>
Oct 26 17:20:48 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:20:48 user nova-compute[75113]:       <nova:ports>
Oct 26 17:20:48 user nova-compute[75113]:         <nova:port uuid="a579d831-4c13-4c14-bb83-d0eae63bfecc">
Oct 26 17:20:48 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 17:20:48 user nova-compute[75113]:         </nova:port>
Oct 26 17:20:48 user nova-compute[75113]:       </nova:ports>
Oct 26 17:20:48 user nova-compute[75113]:     </nova:instance>
Oct 26 17:20:48 user nova-compute[75113]:   </metadata>
Oct 26 17:20:48 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:20:48 user nova-compute[75113]:     <system>
Oct 26 17:20:48 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:20:48 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:20:48 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:20:48 user nova-compute[75113]:       <entry name="serial">f642e634-0efc-4ed2-aa00-ba2d3979b353</entry>
Oct 26 17:20:48 user nova-compute[75113]:       <entry name="uuid">f642e634-0efc-4ed2-aa00-ba2d3979b353</entry>
Oct 26 17:20:48 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:20:48 user nova-compute[75113]:     </system>
Oct 26 17:20:48 user nova-compute[75113]:   </sysinfo>
Oct 26 17:20:48 user nova-compute[75113]:   <os>
Oct 26 17:20:48 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:20:48 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:20:48 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:20:48 user nova-compute[75113]:   </os>
Oct 26 17:20:48 user nova-compute[75113]:   <features>
Oct 26 17:20:48 user nova-compute[75113]:     <acpi/>
Oct 26 17:20:48 user nova-compute[75113]:     <apic/>
Oct 26 17:20:48 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:20:48 user nova-compute[75113]:   </features>
Oct 26 17:20:48 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:20:48 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:20:48 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:20:48 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:20:48 user nova-compute[75113]:   </clock>
Oct 26 17:20:48 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:20:48 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:20:48 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:20:48 user nova-compute[75113]:   </cpu>
Oct 26 17:20:48 user nova-compute[75113]:   <devices>
Oct 26 17:20:48 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:20:48 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:20:48 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk"/>
Oct 26 17:20:48 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:20:48 user nova-compute[75113]:     </disk>
Oct 26 17:20:48 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:20:48 user nova-compute[75113]:       <mac address="fa:16:3e:25:f2:8d"/>
Oct 26 17:20:48 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:20:48 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:20:48 user nova-compute[75113]:       <target dev="tapa579d831-4c"/>
Oct 26 17:20:48 user nova-compute[75113]:     </interface>
Oct 26 17:20:48 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:20:48 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/console.log" append="off"/>
Oct 26 17:20:48 user nova-compute[75113]:     </serial>
Oct 26 17:20:48 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:20:48 user nova-compute[75113]:     <video>
Oct 26 17:20:48 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:20:48 user nova-compute[75113]:     </video>
Oct 26 17:20:48 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:20:48 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:20:48 user nova-compute[75113]:     </rng>
Oct 26 17:20:48 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:20:48 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:20:48 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:20:48 user nova-compute[75113]:     </memballoon>
Oct 26 17:20:48 user nova-compute[75113]:   </devices>
Oct 26 17:20:48 user nova-compute[75113]: </domain>
Oct 26 17:20:48 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1601727451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1601727451',id=38,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/ti9SgfZo5ZxnMZs4A1FtLos6PaWPOYvz9rLDjIoS/K8b7t1GcFvLTOt05j0mGqfEFNT1P6dHavVXrlCDiUYNXeNT+tgzbSr80cX4zrTu374SJVw79aSaRs7elSBabnA==',key_name='tempest-keypair-1190114021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b425dca1e9645ad99fea4b666b01fab',ramdisk_id='',reservation_id='r-uwmu4xiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1688117037',owner_user_name='tempest-AttachVolumeShelveTestJSON-1688117037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b16af3affdf47f596f944cb83f772e9',uuid=f642e634-0efc-4ed2-aa00-ba2d3979b353,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converting VIF {"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG os_vif [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55bda5c1-4e4e-502e-9599-df34aea869fd', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa579d831-4c, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa579d831-4c, col_values=(('qos', UUID('5266e658-c0a2-40ee-b3e2-6968bbc8c3a9')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa579d831-4c, col_values=(('external_ids', {'iface-id': 'a579d831-4c13-4c14-bb83-d0eae63bfecc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:f2:8d', 'vm-uuid': 'f642e634-0efc-4ed2-aa00-ba2d3979b353'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:48 user nova-compute[75113]: INFO os_vif [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c')
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] No VIF found with MAC fa:16:3e:25:f2:8d, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.network.neutron [req-3b91ab5d-e3a7-4ab8-a6b1-f1c70d07a55e req-78208061-2ee5-4979-8426-e3956167c773 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updated VIF entry in instance network info cache for port a579d831-4c13-4c14-bb83-d0eae63bfecc. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG nova.network.neutron [req-3b91ab5d-e3a7-4ab8-a6b1-f1c70d07a55e req-78208061-2ee5-4979-8426-e3956167c773 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updating instance_info_cache with network_info: [{"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:20:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3b91ab5d-e3a7-4ab8-a6b1-f1c70d07a55e req-78208061-2ee5-4979-8426-e3956167c773 service nova] Releasing lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "884b3704-d20c-4207-9a67-3552df05b6a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "884b3704-d20c-4207-9a67-3552df05b6a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:20:49 user nova-compute[75113]: INFO nova.compute.claims [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Claim successful on node user
Oct 26 17:20:49 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:20:49 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:20:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:20:49 user nova-compute[75113]: DEBUG nova.policy [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf60300c4d874a99a5a99bef82641993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d413c67bd3476cbfeb8e39af59e9ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:20:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-8ca1a6d9-2c9a-4368-b7b2-6237ae41dc00 req-3cf5661c-8291-430e-a89d-f0d783928f28 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8ca1a6d9-2c9a-4368-b7b2-6237ae41dc00 req-3cf5661c-8291-430e-a89d-f0d783928f28 service nova] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8ca1a6d9-2c9a-4368-b7b2-6237ae41dc00 req-3cf5661c-8291-430e-a89d-f0d783928f28 service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8ca1a6d9-2c9a-4368-b7b2-6237ae41dc00 req-3cf5661c-8291-430e-a89d-f0d783928f28 service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-8ca1a6d9-2c9a-4368-b7b2-6237ae41dc00 req-3cf5661c-8291-430e-a89d-f0d783928f28 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] No waiting events found dispatching network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:20:50 user nova-compute[75113]: WARNING nova.compute.manager [req-8ca1a6d9-2c9a-4368-b7b2-6237ae41dc00 req-3cf5661c-8291-430e-a89d-f0d783928f28 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received unexpected event network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc for instance with vm_state building and task_state spawning.
Oct 26 17:20:50 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:20:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:20:50 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Creating image(s)
Oct 26 17:20:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "/opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "/opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "/opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "4595462d080f676fe10e531abfea9e8c9ab52117" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "4595462d080f676fe10e531abfea9e8c9ab52117" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117.part --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:51 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Successfully created port: 4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:20:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117.part --force-share --output=json" returned: 0 in 0.207s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:51 user nova-compute[75113]: DEBUG nova.virt.images [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] 91edd9b4-06ab-424e-b386-a849d89a8278 was qcow2, converting to raw {{(pid=75113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 17:20:51 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 17:20:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117.part /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117.converted {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Successfully updated port: 4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-7b268f77-5635-488b-9ba5-ceeb374a7839 req-6fd73130-cc30-4e90-8330-9b4125c96c4f service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7b268f77-5635-488b-9ba5-ceeb374a7839 req-6fd73130-cc30-4e90-8330-9b4125c96c4f service nova] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7b268f77-5635-488b-9ba5-ceeb374a7839 req-6fd73130-cc30-4e90-8330-9b4125c96c4f service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7b268f77-5635-488b-9ba5-ceeb374a7839 req-6fd73130-cc30-4e90-8330-9b4125c96c4f service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-7b268f77-5635-488b-9ba5-ceeb374a7839 req-6fd73130-cc30-4e90-8330-9b4125c96c4f service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] No waiting events found dispatching network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:20:52 user nova-compute[75113]: WARNING nova.compute.manager [req-7b268f77-5635-488b-9ba5-ceeb374a7839 req-6fd73130-cc30-4e90-8330-9b4125c96c4f service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received unexpected event network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc for instance with vm_state building and task_state spawning.
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "refresh_cache-884b3704-d20c-4207-9a67-3552df05b6a2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquired lock "refresh_cache-884b3704-d20c-4207-9a67-3552df05b6a2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117.part /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117.converted" returned: 0 in 1.165s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117.converted --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8710480-fa40-44a3-9488-a8ad4a858c28 req-e5ed23bd-8019-4f38-a9c6-b7d2dca6a8b1 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Received event network-changed-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-e8710480-fa40-44a3-9488-a8ad4a858c28 req-e5ed23bd-8019-4f38-a9c6-b7d2dca6a8b1 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Refreshing instance network info cache due to event network-changed-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8710480-fa40-44a3-9488-a8ad4a858c28 req-e5ed23bd-8019-4f38-a9c6-b7d2dca6a8b1 service nova] Acquiring lock "refresh_cache-884b3704-d20c-4207-9a67-3552df05b6a2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "4595462d080f676fe10e531abfea9e8c9ab52117" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.659s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117 --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "4595462d080f676fe10e531abfea9e8c9ab52117" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "4595462d080f676fe10e531abfea9e8c9ab52117" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:52 user nova-compute[75113]: DEBUG nova.network.neutron [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Updating instance_info_cache with network_info: [{"id": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "address": "fa:16:3e:d9:33:a3", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2cadaf-b4", "ovs_interfaceid": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Releasing lock "refresh_cache-884b3704-d20c-4207-9a67-3552df05b6a2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Instance network_info: |[{"id": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "address": "fa:16:3e:d9:33:a3", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2cadaf-b4", "ovs_interfaceid": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8710480-fa40-44a3-9488-a8ad4a858c28 req-e5ed23bd-8019-4f38-a9c6-b7d2dca6a8b1 service nova] Acquired lock "refresh_cache-884b3704-d20c-4207-9a67-3552df05b6a2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.network.neutron [req-e8710480-fa40-44a3-9488-a8ad4a858c28 req-e5ed23bd-8019-4f38-a9c6-b7d2dca6a8b1 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Refreshing network info cache for port 4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:20:53 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Instance spawned successfully.
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117 --force-share --output=json" returned: 0 in 0.248s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117,backing_fmt=raw /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:53 user nova-compute[75113]: INFO nova.compute.manager [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Took 6.78 seconds to spawn the instance on the hypervisor.
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117,backing_fmt=raw /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk 1073741824" returned: 0 in 0.061s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "4595462d080f676fe10e531abfea9e8c9ab52117" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:53 user nova-compute[75113]: INFO nova.compute.manager [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Took 7.56 seconds to build instance.
Oct 26 17:20:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9ec73cbf-09e7-40e2-a7b4-b558f2b520d7 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.666s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4595462d080f676fe10e531abfea9e8c9ab52117 --force-share --output=json" returned: 0 in 0.219s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Ensure instance console log exists: /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Start _get_guest_xml network_info=[{"id": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "address": "fa:16:3e:d9:33:a3", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2cadaf-b4", "ovs_interfaceid": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b51c553fd7b49702ddd8c3ff4558dd02',container_format='bare',created_at=2023-10-26T17:20:41Z,direct_url=<?>,disk_format='qcow2',id=91edd9b4-06ab-424e-b386-a849d89a8278,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-796199006',owner='95d413c67bd3476cbfeb8e39af59e9ee',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T17:20:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91edd9b4-06ab-424e-b386-a849d89a8278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:20:53 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:20:53 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b51c553fd7b49702ddd8c3ff4558dd02',container_format='bare',created_at=2023-10-26T17:20:41Z,direct_url=<?>,disk_format='qcow2',id=91edd9b4-06ab-424e-b386-a849d89a8278,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-796199006',owner='95d413c67bd3476cbfeb8e39af59e9ee',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T17:20:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:20:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1432880011',display_name='tempest-TestStampPattern-server-1432880011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1432880011',id=39,image_ref='91edd9b4-06ab-424e-b386-a849d89a8278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWHyhdWG4vODww4J36tjcUt2ICXtezA7tiJccfBwgDPh+GMN+tQKBdFq+33nqzyfrbTLq8kX7WTafkfAiBXerZ2BCl1jBxwv1h0P5P+b6z5qmRWoytp+RGBDhwGCxEyfQ==',key_name='tempest-TestStampPattern-754663238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95d413c67bd3476cbfeb8e39af59e9ee',ramdisk_id='',reservation_id='r-0lj4qb4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fc80403d-8fbd-4836-8d01-89fa7aad8d7e',image_min_disk='1',image_min_ram='0',image_owner_id='95d413c67bd3476cbfeb8e39af59e9ee',image_owner_project_name='tempest-TestStampPattern-1797568490',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1797568490-project-member',image_user_id='cf60300c4d874a99a5a99bef82641993',network_allocated='True',owner_project_name='tempest-TestStampPattern-1797568490',owner_user_name='tempest-TestStampPattern-1797568490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:20:50Z,user_data=None,user_id='cf60300c4d874a99a5a99bef82641993',uuid=884b3704-d20c-4207-9a67-3552df05b6a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "address": "fa:16:3e:d9:33:a3", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2cadaf-b4", "ovs_interfaceid": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Converting VIF {"id": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "address": "fa:16:3e:d9:33:a3", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2cadaf-b4", "ovs_interfaceid": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=4f2cadaf-b488-450e-8d2b-76ba4adf9c0e,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2cadaf-b4') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.objects.instance [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lazy-loading 'pci_devices' on Instance uuid 884b3704-d20c-4207-9a67-3552df05b6a2 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:20:53 user nova-compute[75113]:   <uuid>884b3704-d20c-4207-9a67-3552df05b6a2</uuid>
Oct 26 17:20:53 user nova-compute[75113]:   <name>instance-00000027</name>
Oct 26 17:20:53 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:20:53 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:20:53 user nova-compute[75113]:   <metadata>
Oct 26 17:20:53 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:20:53 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:20:53 user nova-compute[75113]:       <nova:name>tempest-TestStampPattern-server-1432880011</nova:name>
Oct 26 17:20:53 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:20:53</nova:creationTime>
Oct 26 17:20:53 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:20:53 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:20:53 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:20:53 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:20:53 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:20:53 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:20:53 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:20:53 user nova-compute[75113]:       <nova:owner>
Oct 26 17:20:53 user nova-compute[75113]:         <nova:user uuid="cf60300c4d874a99a5a99bef82641993">tempest-TestStampPattern-1797568490-project-member</nova:user>
Oct 26 17:20:53 user nova-compute[75113]:         <nova:project uuid="95d413c67bd3476cbfeb8e39af59e9ee">tempest-TestStampPattern-1797568490</nova:project>
Oct 26 17:20:53 user nova-compute[75113]:       </nova:owner>
Oct 26 17:20:53 user nova-compute[75113]:       <nova:root type="image" uuid="91edd9b4-06ab-424e-b386-a849d89a8278"/>
Oct 26 17:20:53 user nova-compute[75113]:       <nova:ports>
Oct 26 17:20:53 user nova-compute[75113]:         <nova:port uuid="4f2cadaf-b488-450e-8d2b-76ba4adf9c0e">
Oct 26 17:20:53 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 17:20:53 user nova-compute[75113]:         </nova:port>
Oct 26 17:20:53 user nova-compute[75113]:       </nova:ports>
Oct 26 17:20:53 user nova-compute[75113]:     </nova:instance>
Oct 26 17:20:53 user nova-compute[75113]:   </metadata>
Oct 26 17:20:53 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:20:53 user nova-compute[75113]:     <system>
Oct 26 17:20:53 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:20:53 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:20:53 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:20:53 user nova-compute[75113]:       <entry name="serial">884b3704-d20c-4207-9a67-3552df05b6a2</entry>
Oct 26 17:20:53 user nova-compute[75113]:       <entry name="uuid">884b3704-d20c-4207-9a67-3552df05b6a2</entry>
Oct 26 17:20:53 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:20:53 user nova-compute[75113]:     </system>
Oct 26 17:20:53 user nova-compute[75113]:   </sysinfo>
Oct 26 17:20:53 user nova-compute[75113]:   <os>
Oct 26 17:20:53 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:20:53 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:20:53 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:20:53 user nova-compute[75113]:   </os>
Oct 26 17:20:53 user nova-compute[75113]:   <features>
Oct 26 17:20:53 user nova-compute[75113]:     <acpi/>
Oct 26 17:20:53 user nova-compute[75113]:     <apic/>
Oct 26 17:20:53 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:20:53 user nova-compute[75113]:   </features>
Oct 26 17:20:53 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:20:53 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:20:53 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:20:53 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:20:53 user nova-compute[75113]:   </clock>
Oct 26 17:20:53 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:20:53 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:20:53 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:20:53 user nova-compute[75113]:   </cpu>
Oct 26 17:20:53 user nova-compute[75113]:   <devices>
Oct 26 17:20:53 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:20:53 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:20:53 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk"/>
Oct 26 17:20:53 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:20:53 user nova-compute[75113]:     </disk>
Oct 26 17:20:53 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:20:53 user nova-compute[75113]:       <mac address="fa:16:3e:d9:33:a3"/>
Oct 26 17:20:53 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:20:53 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:20:53 user nova-compute[75113]:       <target dev="tap4f2cadaf-b4"/>
Oct 26 17:20:53 user nova-compute[75113]:     </interface>
Oct 26 17:20:53 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:20:53 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/console.log" append="off"/>
Oct 26 17:20:53 user nova-compute[75113]:     </serial>
Oct 26 17:20:53 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:20:53 user nova-compute[75113]:     <video>
Oct 26 17:20:53 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:20:53 user nova-compute[75113]:     </video>
Oct 26 17:20:53 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:20:53 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:20:53 user nova-compute[75113]:     </rng>
Oct 26 17:20:53 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:20:53 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:20:53 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:20:53 user nova-compute[75113]:     </memballoon>
Oct 26 17:20:53 user nova-compute[75113]:   </devices>
Oct 26 17:20:53 user nova-compute[75113]: </domain>
Oct 26 17:20:53 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:20:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1432880011',display_name='tempest-TestStampPattern-server-1432880011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1432880011',id=39,image_ref='91edd9b4-06ab-424e-b386-a849d89a8278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWHyhdWG4vODww4J36tjcUt2ICXtezA7tiJccfBwgDPh+GMN+tQKBdFq+33nqzyfrbTLq8kX7WTafkfAiBXerZ2BCl1jBxwv1h0P5P+b6z5qmRWoytp+RGBDhwGCxEyfQ==',key_name='tempest-TestStampPattern-754663238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95d413c67bd3476cbfeb8e39af59e9ee',ramdisk_id='',reservation_id='r-0lj4qb4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fc80403d-8fbd-4836-8d01-89fa7aad8d7e',image_min_disk='1',image_min_ram='0',image_owner_id='95d413c67bd3476cbfeb8e39af59e9ee',image_owner_project_name='tempest-TestStampPattern-1797568490',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1797568490-project-member',image_user_id='cf60300c4d874a99a5a99bef82641993',network_allocated='True',owner_project_name='tempest-TestStampPattern-1797568490',owner_user_name='tempest-TestStampPattern-1797568490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:20:50Z,user_data=None,user_id='cf60300c4d874a99a5a99bef82641993',uuid=884b3704-d20c-4207-9a67-3552df05b6a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "address": "fa:16:3e:d9:33:a3", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2cadaf-b4", "ovs_interfaceid": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Converting VIF {"id": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "address": "fa:16:3e:d9:33:a3", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2cadaf-b4", "ovs_interfaceid": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=4f2cadaf-b488-450e-8d2b-76ba4adf9c0e,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2cadaf-b4') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG os_vif [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=4f2cadaf-b488-450e-8d2b-76ba4adf9c0e,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2cadaf-b4') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a39beb21-e36f-5521-b2c0-001ff271dd73', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f2cadaf-b4, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f2cadaf-b4, col_values=(('qos', UUID('f81bb439-c10a-4388-af6c-c32a7a272954')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f2cadaf-b4, col_values=(('external_ids', {'iface-id': '4f2cadaf-b488-450e-8d2b-76ba4adf9c0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:33:a3', 'vm-uuid': '884b3704-d20c-4207-9a67-3552df05b6a2'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:53 user nova-compute[75113]: INFO os_vif [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=4f2cadaf-b488-450e-8d2b-76ba4adf9c0e,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2cadaf-b4')
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.network.neutron [req-e8710480-fa40-44a3-9488-a8ad4a858c28 req-e5ed23bd-8019-4f38-a9c6-b7d2dca6a8b1 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Updated VIF entry in instance network info cache for port 4f2cadaf-b488-450e-8d2b-76ba4adf9c0e. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.network.neutron [req-e8710480-fa40-44a3-9488-a8ad4a858c28 req-e5ed23bd-8019-4f38-a9c6-b7d2dca6a8b1 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Updating instance_info_cache with network_info: [{"id": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "address": "fa:16:3e:d9:33:a3", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2cadaf-b4", "ovs_interfaceid": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e8710480-fa40-44a3-9488-a8ad4a858c28 req-e5ed23bd-8019-4f38-a9c6-b7d2dca6a8b1 service nova] Releasing lock "refresh_cache-884b3704-d20c-4207-9a67-3552df05b6a2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:20:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] No VIF found with MAC fa:16:3e:d9:33:a3, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:20:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-7e509685-44bd-43a8-b668-41dbb6873539 req-2766bed9-a77e-4702-9ab3-55d04f5722de service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Received event network-vif-plugged-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7e509685-44bd-43a8-b668-41dbb6873539 req-2766bed9-a77e-4702-9ab3-55d04f5722de service nova] Acquiring lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7e509685-44bd-43a8-b668-41dbb6873539 req-2766bed9-a77e-4702-9ab3-55d04f5722de service nova] Lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7e509685-44bd-43a8-b668-41dbb6873539 req-2766bed9-a77e-4702-9ab3-55d04f5722de service nova] Lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-7e509685-44bd-43a8-b668-41dbb6873539 req-2766bed9-a77e-4702-9ab3-55d04f5722de service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] No waiting events found dispatching network-vif-plugged-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:20:55 user nova-compute[75113]: WARNING nova.compute.manager [req-7e509685-44bd-43a8-b668-41dbb6873539 req-2766bed9-a77e-4702-9ab3-55d04f5722de service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Received unexpected event network-vif-plugged-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e for instance with vm_state building and task_state spawning.
Oct 26 17:20:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:56 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:20:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:20:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:20:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:20:57 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Instance spawned successfully.
Oct 26 17:20:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:20:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:20:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-d4584118-5fd2-4525-a166-c0cc03183488 req-032cc96b-c977-4a8c-a809-5a73d51f8067 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Received event network-vif-plugged-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:20:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d4584118-5fd2-4525-a166-c0cc03183488 req-032cc96b-c977-4a8c-a809-5a73d51f8067 service nova] Acquiring lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:20:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d4584118-5fd2-4525-a166-c0cc03183488 req-032cc96b-c977-4a8c-a809-5a73d51f8067 service nova] Lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:20:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d4584118-5fd2-4525-a166-c0cc03183488 req-032cc96b-c977-4a8c-a809-5a73d51f8067 service nova] Lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-d4584118-5fd2-4525-a166-c0cc03183488 req-032cc96b-c977-4a8c-a809-5a73d51f8067 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] No waiting events found dispatching network-vif-plugged-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:20:57 user nova-compute[75113]: WARNING nova.compute.manager [req-d4584118-5fd2-4525-a166-c0cc03183488 req-032cc96b-c977-4a8c-a809-5a73d51f8067 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Received unexpected event network-vif-plugged-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e for instance with vm_state building and task_state spawning.
Oct 26 17:20:57 user nova-compute[75113]: INFO nova.compute.manager [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Took 7.47 seconds to spawn the instance on the hypervisor.
Oct 26 17:20:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:20:57 user nova-compute[75113]: INFO nova.compute.manager [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Took 8.64 seconds to build instance.
Oct 26 17:20:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9f44182f-afbf-4d12-9585-8a52355e78f4 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "884b3704-d20c-4207-9a67-3552df05b6a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.741s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:20:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:21:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:21:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:21:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:21:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:13 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:21:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:15 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 8ef579e4-167c-42cf-bd7a-65d9862f5023 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid fc80403d-8fbd-4836-8d01-89fa7aad8d7e {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 183f0ea9-141a-4df8-98c9-db68420a5bbe {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid f642e634-0efc-4ed2-aa00-ba2d3979b353 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 884b3704-d20c-4207-9a67-3552df05b6a2 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "884b3704-d20c-4207-9a67-3552df05b6a2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "884b3704-d20c-4207-9a67-3552df05b6a2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "884b3704-d20c-4207-9a67-3552df05b6a2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:21:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:21:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:17 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:21:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:21:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:21:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:21:17 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:21:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:21:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:21:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:21:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:21:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:21:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:21:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:21:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:21:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:21:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:21:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:21:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:21:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:21:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:21:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:21:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:21:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:21:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:21:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:21:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:21:19 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:21:19 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:21:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8223MB free_disk=25.021690368652344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:21:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:21:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:21:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 8ef579e4-167c-42cf-bd7a-65d9862f5023 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:21:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:21:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 183f0ea9-141a-4df8-98c9-db68420a5bbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:21:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance f642e634-0efc-4ed2-aa00-ba2d3979b353 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:21:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 884b3704-d20c-4207-9a67-3552df05b6a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:21:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:21:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:21:20 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:21:20 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:21:20 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:21:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:21:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:21:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:21:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-8ef579e4-167c-42cf-bd7a-65d9862f5023" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:21:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-8ef579e4-167c-42cf-bd7a-65d9862f5023" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:21:25 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:21:25 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Updating instance_info_cache with network_info: [{"id": "836188fa-7993-45db-b0e8-4fc2209a9785", "address": "fa:16:3e:14:57:0d", "network": {"id": "5ae68db4-1ba4-4cfb-8ce2-164950042964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1147509509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5c232b5ce547b18483b295e460c475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836188fa-79", "ovs_interfaceid": "836188fa-7993-45db-b0e8-4fc2209a9785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:21:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-8ef579e4-167c-42cf-bd7a-65d9862f5023" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:21:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:21:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:21:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:21:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:21:26 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:21:26 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:21:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:34 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:21:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:21:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:21:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:21:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:21:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:21:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:21:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:21:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:21:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Acquiring lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:21:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:21:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Acquiring lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:21:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:21:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:21:55 user nova-compute[75113]: INFO nova.compute.manager [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Terminating instance
Oct 26 17:21:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-65532fd7-8e12-4da8-a810-ca498f3b0eb7 req-154aa900-21a7-4aeb-9c68-01c1df73e1f1 service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Received event network-vif-unplugged-836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-65532fd7-8e12-4da8-a810-ca498f3b0eb7 req-154aa900-21a7-4aeb-9c68-01c1df73e1f1 service nova] Acquiring lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-65532fd7-8e12-4da8-a810-ca498f3b0eb7 req-154aa900-21a7-4aeb-9c68-01c1df73e1f1 service nova] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-65532fd7-8e12-4da8-a810-ca498f3b0eb7 req-154aa900-21a7-4aeb-9c68-01c1df73e1f1 service nova] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-65532fd7-8e12-4da8-a810-ca498f3b0eb7 req-154aa900-21a7-4aeb-9c68-01c1df73e1f1 service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] No waiting events found dispatching network-vif-unplugged-836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-65532fd7-8e12-4da8-a810-ca498f3b0eb7 req-154aa900-21a7-4aeb-9c68-01c1df73e1f1 service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Received event network-vif-unplugged-836188fa-7993-45db-b0e8-4fc2209a9785 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:21:56 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Instance destroyed successfully.
Oct 26 17:21:56 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lazy-loading 'resources' on Instance uuid 8ef579e4-167c-42cf-bd7a-65d9862f5023 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2065846528',display_name='tempest-TestServerVolumeAttachmentScenario-server-2065846528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2065846528',id=35,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqLOv2dKzncAwePesQ4yoiihPNvEeXEmJLfrGoUCADqAmjRd305PbTwQz+4BpO19/XU8MGP1cVq6e7FmamMjWPcTStg2SvVC+UTE/8LWokAyk98R9Pm4Y4OEFKRVr7iWQ==',key_name='tempest-keypair-964175039',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:16:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a5c232b5ce547b18483b295e460c475',ramdisk_id='',reservation_id='r-jc950jrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1127476989',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1127476989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aad9d7f0c664d3fb0bfccbe33f931f6',uuid=8ef579e4-167c-42cf-bd7a-65d9862f5023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "836188fa-7993-45db-b0e8-4fc2209a9785", "address": "fa:16:3e:14:57:0d", "network": {"id": "5ae68db4-1ba4-4cfb-8ce2-164950042964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1147509509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5c232b5ce547b18483b295e460c475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836188fa-79", "ovs_interfaceid": "836188fa-7993-45db-b0e8-4fc2209a9785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Converting VIF {"id": "836188fa-7993-45db-b0e8-4fc2209a9785", "address": "fa:16:3e:14:57:0d", "network": {"id": "5ae68db4-1ba4-4cfb-8ce2-164950042964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1147509509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5c232b5ce547b18483b295e460c475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836188fa-79", "ovs_interfaceid": "836188fa-7993-45db-b0e8-4fc2209a9785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:57:0d,bridge_name='br-int',has_traffic_filtering=True,id=836188fa-7993-45db-b0e8-4fc2209a9785,network=Network(5ae68db4-1ba4-4cfb-8ce2-164950042964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836188fa-79') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG os_vif [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:57:0d,bridge_name='br-int',has_traffic_filtering=True,id=836188fa-7993-45db-b0e8-4fc2209a9785,network=Network(5ae68db4-1ba4-4cfb-8ce2-164950042964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836188fa-79') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap836188fa-79, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0e4e9fd-48cb-4425-9bb0-878b8dd6759d) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:21:56 user nova-compute[75113]: INFO os_vif [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:57:0d,bridge_name='br-int',has_traffic_filtering=True,id=836188fa-7993-45db-b0e8-4fc2209a9785,network=Network(5ae68db4-1ba4-4cfb-8ce2-164950042964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836188fa-79')
Oct 26 17:21:56 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Deleting instance files /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023_del
Oct 26 17:21:56 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Deletion of /opt/stack/data/nova/instances/8ef579e4-167c-42cf-bd7a-65d9862f5023_del complete
Oct 26 17:21:56 user nova-compute[75113]: INFO nova.compute.manager [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 26 17:21:56 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:21:56 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:21:57 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:21:57 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Took 0.76 seconds to deallocate network for instance.
Oct 26 17:21:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:21:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:21:57 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:21:57 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:21:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:21:57 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Deleted allocations for instance 8ef579e4-167c-42cf-bd7a-65d9862f5023
Oct 26 17:21:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a0250f06-030f-4352-b04f-d017abd9f024 tempest-TestServerVolumeAttachmentScenario-1127476989 tempest-TestServerVolumeAttachmentScenario-1127476989-project-member] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.202s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:21:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-b111dda8-f909-4629-8e57-5432c7b1b3cd req-9ec94083-09fc-4491-a7db-18ddfde61c4b service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Received event network-vif-plugged-836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:21:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b111dda8-f909-4629-8e57-5432c7b1b3cd req-9ec94083-09fc-4491-a7db-18ddfde61c4b service nova] Acquiring lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:21:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b111dda8-f909-4629-8e57-5432c7b1b3cd req-9ec94083-09fc-4491-a7db-18ddfde61c4b service nova] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:21:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b111dda8-f909-4629-8e57-5432c7b1b3cd req-9ec94083-09fc-4491-a7db-18ddfde61c4b service nova] Lock "8ef579e4-167c-42cf-bd7a-65d9862f5023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:21:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-b111dda8-f909-4629-8e57-5432c7b1b3cd req-9ec94083-09fc-4491-a7db-18ddfde61c4b service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] No waiting events found dispatching network-vif-plugged-836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:21:58 user nova-compute[75113]: WARNING nova.compute.manager [req-b111dda8-f909-4629-8e57-5432c7b1b3cd req-9ec94083-09fc-4491-a7db-18ddfde61c4b service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Received unexpected event network-vif-plugged-836188fa-7993-45db-b0e8-4fc2209a9785 for instance with vm_state deleted and task_state None.
Oct 26 17:21:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-b111dda8-f909-4629-8e57-5432c7b1b3cd req-9ec94083-09fc-4491-a7db-18ddfde61c4b service nova] [instance: 8ef579e4-167c-42cf-bd7a-65d9862f5023] Received event network-vif-deleted-836188fa-7993-45db-b0e8-4fc2209a9785 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:22:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:22:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:22:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:22:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:22:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:22:15 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:22:15 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:22:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:22:17 user nova-compute[75113]: DEBUG nova.compute.manager [req-a7f97beb-2d01-4347-bb56-3bd7d54e049b req-5b2693b9-2808-4a93-8c69-dd5d0fc14e0a service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Received event network-changed-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:22:17 user nova-compute[75113]: DEBUG nova.compute.manager [req-a7f97beb-2d01-4347-bb56-3bd7d54e049b req-5b2693b9-2808-4a93-8c69-dd5d0fc14e0a service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Refreshing instance network info cache due to event network-changed-991d39e0-d395-48e6-b6d9-e1d9868b1ca9. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:22:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a7f97beb-2d01-4347-bb56-3bd7d54e049b req-5b2693b9-2808-4a93-8c69-dd5d0fc14e0a service nova] Acquiring lock "refresh_cache-183f0ea9-141a-4df8-98c9-db68420a5bbe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:22:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a7f97beb-2d01-4347-bb56-3bd7d54e049b req-5b2693b9-2808-4a93-8c69-dd5d0fc14e0a service nova] Acquired lock "refresh_cache-183f0ea9-141a-4df8-98c9-db68420a5bbe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:22:17 user nova-compute[75113]: DEBUG nova.network.neutron [req-a7f97beb-2d01-4347-bb56-3bd7d54e049b req-5b2693b9-2808-4a93-8c69-dd5d0fc14e0a service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Refreshing network info cache for port 991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:22:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:17 user nova-compute[75113]: DEBUG nova.network.neutron [req-a7f97beb-2d01-4347-bb56-3bd7d54e049b req-5b2693b9-2808-4a93-8c69-dd5d0fc14e0a service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Updated VIF entry in instance network info cache for port 991d39e0-d395-48e6-b6d9-e1d9868b1ca9. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:22:17 user nova-compute[75113]: DEBUG nova.network.neutron [req-a7f97beb-2d01-4347-bb56-3bd7d54e049b req-5b2693b9-2808-4a93-8c69-dd5d0fc14e0a service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Updating instance_info_cache with network_info: [{"id": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "address": "fa:16:3e:2e:29:e3", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991d39e0-d3", "ovs_interfaceid": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:22:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a7f97beb-2d01-4347-bb56-3bd7d54e049b req-5b2693b9-2808-4a93-8c69-dd5d0fc14e0a service nova] Releasing lock "refresh_cache-183f0ea9-141a-4df8-98c9-db68420a5bbe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:22:19 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:22:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:22:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:22:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:22:19 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:22:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:19 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:21 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:22:21 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:22:21 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8477MB free_disk=25.047168731689453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:22:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:22:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:22:21 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:22:21 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 183f0ea9-141a-4df8-98c9-db68420a5bbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:22:21 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance f642e634-0efc-4ed2-aa00-ba2d3979b353 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:22:21 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 884b3704-d20c-4207-9a67-3552df05b6a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:22:21 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:22:21 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:22:21 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:22:21 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:22:21 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:22:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:22:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG nova.objects.instance [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'flavor' on Instance uuid 183f0ea9-141a-4df8-98c9-db68420a5bbe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:22:23 user nova-compute[75113]: INFO nova.compute.manager [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Attaching volume a9777e0b-48dc-4a2a-9df2-a1346d7c3feb to /dev/vdb
Oct 26 17:22:23 user nova-compute[75113]: DEBUG os_brick.utils [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c64fab-33e5-41ed-816b-9ff83c4cc163]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32143d7-24e8-4e60-9667-f8079fb265ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a602cec-99b2-4b06-9ac4-9a38ba399652]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e59166-ecb5-4b85-ad23-c30f1eaf1e09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:22:23 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:22:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d052c7b5-4126-4053-8a57-100ff1e6b7af]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG os_brick.utils [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:22:23 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Updating existing volume attachment record: ce0ef68d-23b5-487b-90ca-84befc88928b {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:22:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:22:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:22:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:22:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:22:24 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:22:25 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updating instance_info_cache with network_info: [{"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:22:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:22:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:22:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:22:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:22:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:22:26 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:22:26 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:22:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:36 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:22:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:37 user nova-compute[75113]: DEBUG nova.compute.manager [req-9012930a-ba42-4887-a6ab-f2d316289a28 req-b1ac74a8-82d5-4a6d-8b40-c88431148653 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-changed-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:22:37 user nova-compute[75113]: DEBUG nova.compute.manager [req-9012930a-ba42-4887-a6ab-f2d316289a28 req-b1ac74a8-82d5-4a6d-8b40-c88431148653 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Refreshing instance network info cache due to event network-changed-a579d831-4c13-4c14-bb83-d0eae63bfecc. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:22:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9012930a-ba42-4887-a6ab-f2d316289a28 req-b1ac74a8-82d5-4a6d-8b40-c88431148653 service nova] Acquiring lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:22:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9012930a-ba42-4887-a6ab-f2d316289a28 req-b1ac74a8-82d5-4a6d-8b40-c88431148653 service nova] Acquired lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:22:37 user nova-compute[75113]: DEBUG nova.network.neutron [req-9012930a-ba42-4887-a6ab-f2d316289a28 req-b1ac74a8-82d5-4a6d-8b40-c88431148653 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Refreshing network info cache for port a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:22:37 user nova-compute[75113]: DEBUG nova.network.neutron [req-9012930a-ba42-4887-a6ab-f2d316289a28 req-b1ac74a8-82d5-4a6d-8b40-c88431148653 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updated VIF entry in instance network info cache for port a579d831-4c13-4c14-bb83-d0eae63bfecc. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:22:37 user nova-compute[75113]: DEBUG nova.network.neutron [req-9012930a-ba42-4887-a6ab-f2d316289a28 req-b1ac74a8-82d5-4a6d-8b40-c88431148653 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updating instance_info_cache with network_info: [{"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:22:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9012930a-ba42-4887-a6ab-f2d316289a28 req-b1ac74a8-82d5-4a6d-8b40-c88431148653 service nova] Releasing lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:22:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-676cac06-0bc8-4f50-a3dc-12ec8f7a5821 req-2a589bae-10d0-4b01-8009-e32d5a739b92 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Received event network-changed-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-676cac06-0bc8-4f50-a3dc-12ec8f7a5821 req-2a589bae-10d0-4b01-8009-e32d5a739b92 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Refreshing instance network info cache due to event network-changed-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-676cac06-0bc8-4f50-a3dc-12ec8f7a5821 req-2a589bae-10d0-4b01-8009-e32d5a739b92 service nova] Acquiring lock "refresh_cache-884b3704-d20c-4207-9a67-3552df05b6a2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-676cac06-0bc8-4f50-a3dc-12ec8f7a5821 req-2a589bae-10d0-4b01-8009-e32d5a739b92 service nova] Acquired lock "refresh_cache-884b3704-d20c-4207-9a67-3552df05b6a2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG nova.network.neutron [req-676cac06-0bc8-4f50-a3dc-12ec8f7a5821 req-2a589bae-10d0-4b01-8009-e32d5a739b92 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Refreshing network info cache for port 4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huKimcXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:22:41 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:22:41 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:22:41 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d951c029-9727-45a7-bf54-c302ce4ca32b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:22:41 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7adbb0-35c9-4732-bad6-b81d375ef825]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb] added
Oct 26 17:22:41 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "884b3704-d20c-4207-9a67-3552df05b6a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "884b3704-d20c-4207-9a67-3552df05b6a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[21133752-5dee-4e3e-a1c0-7114c60b477d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG nova.objects.instance [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lazy-loading 'flavor' on Instance uuid 884b3704-d20c-4207-9a67-3552df05b6a2 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8779a35-1f6a-4291-ba54-5049926970a8]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v huKimcXU {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "884b3704-d20c-4207-9a67-3552df05b6a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v huKimcXU" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e14ff42-8e4d-404a-8669-87fefa2fc6da]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'huKimcXU'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2711c49a-c9fe-4923-9507-f674109e3f52]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7009a2f1-c2ae-477a-8fef-1a575a0b16cf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:22:41 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:22:41 user nova-compute[75113]:  {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:22:41 user nova-compute[75113]: WARNING os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 17:22:41 user nova-compute[75113]: 
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[072728d7-4757-4220-95db-3ab73365ff4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb, portal: 172.16.0.220,3260]
Oct 26 17:22:41 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb, portal: 172.16.0.220,3260] successful.
Oct 26 17:22:41 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[657f346d-4f36-4897-884c-db14f819d505]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "884b3704-d20c-4207-9a67-3552df05b6a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "884b3704-d20c-4207-9a67-3552df05b6a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:22:41 user nova-compute[75113]: INFO nova.compute.manager [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Attaching volume 2ddd441d-925d-4add-b351-731ec44ab09d to /dev/vdb
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa8afd5-b39b-4d77-868c-cb945b422137]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:22:41 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:22:41 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fb20a5-a58e-4944-ae65-949b1c5aae57]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:22:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huKimcXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG os_brick.utils [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7e0671-6eaa-4049-bd40-adbc4c8456a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG nova.network.neutron [req-676cac06-0bc8-4f50-a3dc-12ec8f7a5821 req-2a589bae-10d0-4b01-8009-e32d5a739b92 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Updated VIF entry in instance network info cache for port 4f2cadaf-b488-450e-8d2b-76ba4adf9c0e. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG nova.network.neutron [req-676cac06-0bc8-4f50-a3dc-12ec8f7a5821 req-2a589bae-10d0-4b01-8009-e32d5a739b92 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Updating instance_info_cache with network_info: [{"id": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "address": "fa:16:3e:d9:33:a3", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2cadaf-b4", "ovs_interfaceid": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ae94be-f87b-4de2-9196-bbd257d8edd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-676cac06-0bc8-4f50-a3dc-12ec8f7a5821 req-2a589bae-10d0-4b01-8009-e32d5a739b92 service nova] Releasing lock "refresh_cache-884b3704-d20c-4207-9a67-3552df05b6a2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[162e9ce5-8bc4-485c-a8a7-4ee6de68dd6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10f020d-00d7-487b-bfc1-f2bc61aaab57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:22:42 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:22:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cc2eb2-7710-42ac-bfd3-09a83501d6c9]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG os_brick.utils [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Updating existing volume attachment record: ae689284-c2ec-4350-9a5f-e55cb8ed5cac {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23539323539363334', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539323539363334', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:22:42 user nova-compute[75113]: DEBUG nova.objects.instance [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'flavor' on Instance uuid 183f0ea9-141a-4df8-98c9-db68420a5bbe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:22:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:22:43 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:22:43 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:22:43 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:22:43 user nova-compute[75113]:   <serial>a9777e0b-48dc-4a2a-9df2-a1346d7c3feb</serial>
Oct 26 17:22:43 user nova-compute[75113]: </disk>
Oct 26 17:22:43 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:22:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:22:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:22:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No VIF found with MAC fa:16:3e:2e:29:e3, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:22:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1b729cab-acfc-4514-85ea-e9735573a698 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.363s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:22:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:22:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:22:44 user nova-compute[75113]: INFO nova.compute.manager [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Shelving
Oct 26 17:22:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-a65993a7-71d9-46a0-9c76-36eedb99e402 req-47f20078-3e8a-4c6f-b8fe-a8312b688dfa service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-vif-unplugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:22:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a65993a7-71d9-46a0-9c76-36eedb99e402 req-47f20078-3e8a-4c6f-b8fe-a8312b688dfa service nova] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:22:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a65993a7-71d9-46a0-9c76-36eedb99e402 req-47f20078-3e8a-4c6f-b8fe-a8312b688dfa service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:22:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a65993a7-71d9-46a0-9c76-36eedb99e402 req-47f20078-3e8a-4c6f-b8fe-a8312b688dfa service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:22:44 user nova-compute[75113]: DEBUG nova.compute.manager [req-a65993a7-71d9-46a0-9c76-36eedb99e402 req-47f20078-3e8a-4c6f-b8fe-a8312b688dfa service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] No waiting events found dispatching network-vif-unplugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:22:44 user nova-compute[75113]: WARNING nova.compute.manager [req-a65993a7-71d9-46a0-9c76-36eedb99e402 req-47f20078-3e8a-4c6f-b8fe-a8312b688dfa service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received unexpected event network-vif-unplugged-a579d831-4c13-4c14-bb83-d0eae63bfecc for instance with vm_state active and task_state shelving.
Oct 26 17:22:44 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Instance destroyed successfully.
Oct 26 17:22:45 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Beginning cold snapshot process
Oct 26 17:22:45 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 17:22:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk /opt/stack/data/nova/instances/snapshots/tmpfkfrkbbq/8bf5b62358b74f7a8cca321cd6dc73af {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk /opt/stack/data/nova/instances/snapshots/tmpfkfrkbbq/8bf5b62358b74f7a8cca321cd6dc73af" returned: 0 in 0.550s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:45 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Snapshot extracted, beginning image upload
Oct 26 17:22:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-fec0ca9d-a653-4704-9afa-fc8085cc89f6 req-67ae7580-e824-47dd-8b51-e3ce0fdff79a service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:22:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fec0ca9d-a653-4704-9afa-fc8085cc89f6 req-67ae7580-e824-47dd-8b51-e3ce0fdff79a service nova] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:22:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fec0ca9d-a653-4704-9afa-fc8085cc89f6 req-67ae7580-e824-47dd-8b51-e3ce0fdff79a service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:22:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fec0ca9d-a653-4704-9afa-fc8085cc89f6 req-67ae7580-e824-47dd-8b51-e3ce0fdff79a service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:22:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-fec0ca9d-a653-4704-9afa-fc8085cc89f6 req-67ae7580-e824-47dd-8b51-e3ce0fdff79a service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] No waiting events found dispatching network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:22:46 user nova-compute[75113]: WARNING nova.compute.manager [req-fec0ca9d-a653-4704-9afa-fc8085cc89f6 req-67ae7580-e824-47dd-8b51-e3ce0fdff79a service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received unexpected event network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 17:22:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:48 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Snapshot image upload complete
Oct 26 17:22:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:22:49 user nova-compute[75113]: INFO nova.compute.manager [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Shelve offloading
Oct 26 17:22:49 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Instance destroyed successfully.
Oct 26 17:22:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:22:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:22:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquired lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:22:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:22:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updating instance_info_cache with network_info: [{"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:22:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Releasing lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:22:50 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Instance destroyed successfully.
Oct 26 17:22:50 user nova-compute[75113]: DEBUG nova.objects.instance [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'resources' on Instance uuid f642e634-0efc-4ed2-aa00-ba2d3979b353 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1601727451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1601727451',id=38,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/ti9SgfZo5ZxnMZs4A1FtLos6PaWPOYvz9rLDjIoS/K8b7t1GcFvLTOt05j0mGqfEFNT1P6dHavVXrlCDiUYNXeNT+tgzbSr80cX4zrTu374SJVw79aSaRs7elSBabnA==',key_name='tempest-keypair-1190114021',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:20:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2b425dca1e9645ad99fea4b666b01fab',ramdisk_id='',reservation_id='r-uwmu4xiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1688117037',owner_user_name='tempest-AttachVolumeShelveTestJSON-1688117037-project-member',shelved_at='2023-10-26T17:22:48.949196',shelved_host='user',shelved_image_id='0bb9e4df-d74b-4a38-91b7-43b9d1ecddaf'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b16af3affdf47f596f944cb83f772e9',uuid=f642e634-0efc-4ed2-aa00-ba2d3979b353,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converting VIF {"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG os_vif [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa579d831-4c, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5266e658-c0a2-40ee-b3e2-6968bbc8c3a9) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:50 user nova-compute[75113]: INFO os_vif [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c')
Oct 26 17:22:50 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Deleting instance files /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353_del
Oct 26 17:22:50 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Deletion of /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353_del complete
Oct 26 17:22:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-708ecb2e-1bd0-4b0b-aaf4-19ed8a597637 req-339c3189-cd9a-41e1-8aee-35f6636a0da4 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-changed-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-708ecb2e-1bd0-4b0b-aaf4-19ed8a597637 req-339c3189-cd9a-41e1-8aee-35f6636a0da4 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Refreshing instance network info cache due to event network-changed-a579d831-4c13-4c14-bb83-d0eae63bfecc. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-708ecb2e-1bd0-4b0b-aaf4-19ed8a597637 req-339c3189-cd9a-41e1-8aee-35f6636a0da4 service nova] Acquiring lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-708ecb2e-1bd0-4b0b-aaf4-19ed8a597637 req-339c3189-cd9a-41e1-8aee-35f6636a0da4 service nova] Acquired lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG nova.network.neutron [req-708ecb2e-1bd0-4b0b-aaf4-19ed8a597637 req-339c3189-cd9a-41e1-8aee-35f6636a0da4 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Refreshing network info cache for port a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:22:50 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Deleted allocations for instance f642e634-0efc-4ed2-aa00-ba2d3979b353
Oct 26 17:22:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG nova.objects.instance [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'flavor' on Instance uuid 183f0ea9-141a-4df8-98c9-db68420a5bbe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG nova.objects.instance [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'numa_topology' on Instance uuid f642e634-0efc-4ed2-aa00-ba2d3979b353 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG nova.objects.base [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Object Instance<f642e634-0efc-4ed2-aa00-ba2d3979b353> lazy-loaded attributes: resources,numa_topology {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:22:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:22:51 user nova-compute[75113]: INFO nova.compute.manager [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Attaching volume 14139a2c-e9a3-4b26-96bb-1cf919d916d9 to /dev/vdc
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-1c8e901d-2070-4e8c-9f09-447da4879d7d tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.873s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG os_brick.utils [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG nova.network.neutron [req-708ecb2e-1bd0-4b0b-aaf4-19ed8a597637 req-339c3189-cd9a-41e1-8aee-35f6636a0da4 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updated VIF entry in instance network info cache for port a579d831-4c13-4c14-bb83-d0eae63bfecc. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG nova.network.neutron [req-708ecb2e-1bd0-4b0b-aaf4-19ed8a597637 req-339c3189-cd9a-41e1-8aee-35f6636a0da4 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updating instance_info_cache with network_info: [{"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa579d831-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eaf5b2-c8f6-4dbe-98bd-bea50c62314c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-708ecb2e-1bd0-4b0b-aaf4-19ed8a597637 req-339c3189-cd9a-41e1-8aee-35f6636a0da4 service nova] Releasing lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bbf47a-058c-44ad-be99-4f08270f662d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f86d28f-e96b-48f0-ac30-d4fd58424282]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4014ff-88d4-4e23-8c00-bae062612f0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:22:51 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:22:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[422fe512-8687-4640-9faa-17f72ba28064]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG os_brick.utils [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:22:51 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Updating existing volume attachment record: dbc09ca9-1eb5-4edf-8232-7c17f759aeb3 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:22:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:22:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBCyRPhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:23:03 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:23:03 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:23:03 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaed77fc-1272-4f86-b93d-a8786bde57d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:23:03 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad10c451-8809-4fd5-a5ce-beb2307ac4bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d] added
Oct 26 17:23:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[401900f3-64d0-4d43-ab0f-bc89ed86c222]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca68b92-a017-47f8-8d9b-3e079e08719a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBCyRPhj {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBCyRPhj" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[209ddde0-b2ec-475e-9618-d0077ce94c89]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iBCyRPhj'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f1134e-05b1-47c2-ba9d-e111a7608482]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[56057f41-2d58-4ff4-a89e-8ac85300b63b]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:23:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:23:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a23dc4-c6b5-430f-b913-48204ed9ff38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d, portal: 172.16.0.220,3260]
Oct 26 17:23:03 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d, portal: 172.16.0.220,3260] successful.
Oct 26 17:23:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb1bea6-b93d-4c6e-b710-b5cc0dad7b1a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe315ff-4c6f-4547-8996-4ab168583a95]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:23:03 user nova-compute[75113]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d (non-flash)
Oct 26 17:23:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:23:03 user nova-compute[75113]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d (non-flash)
Oct 26 17:23:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceafc3cc-0311-4a74-bc47-4b3145d34432]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:23:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBCyRPhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:23:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:23:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23665626463393534', 'path': '/dev/sdc'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:23:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665626463393534', 'path': '/dev/sdc'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:23:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lazy-loading 'flavor' on Instance uuid 884b3704-d20c-4207-9a67-3552df05b6a2 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:23:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:23:04 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:23:04 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:23:04 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:23:04 user nova-compute[75113]:   <serial>2ddd441d-925d-4add-b351-731ec44ab09d</serial>
Oct 26 17:23:04 user nova-compute[75113]: </disk>
Oct 26 17:23:04 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:23:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:23:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:23:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] No VIF found with MAC fa:16:3e:d9:33:a3, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:23:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-409cc2fd-a0d8-4a16-a13c-8b2d11903e22 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "884b3704-d20c-4207-9a67-3552df05b6a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.072s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:23:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:23:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:23:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:23:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:23:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "884b3704-d20c-4207-9a67-3552df05b6a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:23:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "884b3704-d20c-4207-9a67-3552df05b6a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:23:06 user nova-compute[75113]: INFO nova.compute.manager [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Detaching volume 2ddd441d-925d-4add-b351-731ec44ab09d
Oct 26 17:23:06 user nova-compute[75113]: INFO nova.virt.block_device [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Attempting to driver detach volume 2ddd441d-925d-4add-b351-731ec44ab09d from mountpoint /dev/vdb
Oct 26 17:23:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Attempting to detach device vdb from instance 884b3704-d20c-4207-9a67-3552df05b6a2 from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:23:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:23:06 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:23:06 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:23:06 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:23:06 user nova-compute[75113]:   <serial>2ddd441d-925d-4add-b351-731ec44ab09d</serial>
Oct 26 17:23:06 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:23:06 user nova-compute[75113]: </disk>
Oct 26 17:23:06 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:23:06 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Successfully detached device vdb from instance 884b3704-d20c-4207-9a67-3552df05b6a2 from the persistent domain config.
Oct 26 17:23:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 884b3704-d20c-4207-9a67-3552df05b6a2 from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:23:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:23:06 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:23:06 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:23:06 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:23:06 user nova-compute[75113]:   <serial>2ddd441d-925d-4add-b351-731ec44ab09d</serial>
Oct 26 17:23:06 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:23:06 user nova-compute[75113]: </disk>
Oct 26 17:23:06 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:23:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 884b3704-d20c-4207-9a67-3552df05b6a2 {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:23:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbXLZmug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:23:11 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:23:11 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:23:11 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1ddc80-1e3f-4d05-aae6-2d4964f9fa6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:23:11 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a138a46a-4d6b-4f12-bba3-74f97be56f4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9] added
Oct 26 17:23:11 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a318aea4-8238-4fe2-afb2-ce177c9f6c11]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[554a6eaf-9316-4ae2-8136-38ab40e3fc2e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbXLZmug {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbXLZmug" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8eaf0f-25bc-4d67-a84b-b18b2515e209]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BbXLZmug'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[608c0ec9-c6d2-4705-be77-2e009a10947a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c53d22-4916-41a1-bb61-38e9822f3503]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:23:11 user nova-compute[75113]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d (non-flash)
Oct 26 17:23:11 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:23:11 user nova-compute[75113]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d (non-flash)
Oct 26 17:23:11 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[725a9a91-875e-48f8-8023-40d03a4a6289]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9, portal: 172.16.0.220,3260]
Oct 26 17:23:11 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9, portal: 172.16.0.220,3260] successful.
Oct 26 17:23:11 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8296545-dde7-4518-856a-807f2a176606]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a82a241-08a7-4da4-ac2b-02397f466095]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:23:11 user nova-compute[75113]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d (non-flash)
Oct 26 17:23:11 user nova-compute[75113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 (non-flash)
Oct 26 17:23:11 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:23:11 user nova-compute[75113]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d (non-flash)
Oct 26 17:23:11 user nova-compute[75113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 (non-flash)
Oct 26 17:23:11 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de3a35a-881b-4300-b098-e41a3062464c]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:11 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:23:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:12 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:23:12 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbXLZmug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:23:12 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:23:12 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23530336535396161', 'path': '/dev/sdd'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:23:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530336535396161', 'path': '/dev/sdd'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:23:12 user nova-compute[75113]: DEBUG nova.objects.instance [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'flavor' on Instance uuid 183f0ea9-141a-4df8-98c9-db68420a5bbe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:23:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:23:12 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:23:12 user nova-compute[75113]:   <source dev="/dev/sdd"/>
Oct 26 17:23:12 user nova-compute[75113]:   <target dev="vdc" bus="virtio"/>
Oct 26 17:23:12 user nova-compute[75113]:   <serial>14139a2c-e9a3-4b26-96bb-1cf919d916d9</serial>
Oct 26 17:23:12 user nova-compute[75113]: </disk>
Oct 26 17:23:12 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:23:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:23:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:23:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:23:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] No VIF found with MAC fa:16:3e:2e:29:e3, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:23:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-435e96c2-6641-4f68-b1a4-a23bd2db5d95 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.918s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:23:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:23:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:23:14 user nova-compute[75113]: INFO nova.compute.manager [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Detaching volume a9777e0b-48dc-4a2a-9df2-a1346d7c3feb
Oct 26 17:23:14 user nova-compute[75113]: INFO nova.virt.block_device [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Attempting to driver detach volume a9777e0b-48dc-4a2a-9df2-a1346d7c3feb from mountpoint /dev/vdb
Oct 26 17:23:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Attempting to detach device vdb from instance 183f0ea9-141a-4df8-98c9-db68420a5bbe from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:23:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:23:14 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:23:14 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:23:14 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:23:14 user nova-compute[75113]:   <serial>a9777e0b-48dc-4a2a-9df2-a1346d7c3feb</serial>
Oct 26 17:23:14 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:23:14 user nova-compute[75113]: </disk>
Oct 26 17:23:14 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:23:14 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully detached device vdb from instance 183f0ea9-141a-4df8-98c9-db68420a5bbe from the persistent domain config.
Oct 26 17:23:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 183f0ea9-141a-4df8-98c9-db68420a5bbe from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:23:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:23:14 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:23:14 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:23:14 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:23:14 user nova-compute[75113]:   <serial>a9777e0b-48dc-4a2a-9df2-a1346d7c3feb</serial>
Oct 26 17:23:14 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:23:14 user nova-compute[75113]: </disk>
Oct 26 17:23:14 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:23:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 183f0ea9-141a-4df8-98c9-db68420a5bbe {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:23:15 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:23:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:17 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:23:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:23:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:23:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:23:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:23:21 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:23:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:21 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:23:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:22 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:22 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:23:22 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:23:22 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8601MB free_disk=25.004653930664062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:23:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:23:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:23:23 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:23:23 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 183f0ea9-141a-4df8-98c9-db68420a5bbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:23:23 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 884b3704-d20c-4207-9a67-3552df05b6a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:23:23 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:23:23 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:23:23 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:23:23 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:23:23 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:23:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:23:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:23:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:23:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:23:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:23:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:23:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:23:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:23:24 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:23:24 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid fc80403d-8fbd-4836-8d01-89fa7aad8d7e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:23:24 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updating instance_info_cache with network_info: [{"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:23:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:23:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:23:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:23:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:26 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:23:26 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:23:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:27 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 884b3704-d20c-4207-9a67-3552df05b6a2 is timed out.
Oct 26 17:23:27 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Successfully detached device vdb from instance 884b3704-d20c-4207-9a67-3552df05b6a2 from the live domain config.
Oct 26 17:23:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBCyRPhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:23:27 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc6e3c4-727f-47d8-be08-6fe824c03182]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:23:27 user nova-compute[75113]: No targets found.
Oct 26 17:23:27 user nova-compute[75113]: iSNS:
Oct 26 17:23:27 user nova-compute[75113]: No targets found.
Oct 26 17:23:27 user nova-compute[75113]: STATIC:
Oct 26 17:23:27 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d
Oct 26 17:23:27 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:23:27 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:23:27 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb
Oct 26 17:23:27 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:23:27 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:23:27 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9
Oct 26 17:23:27 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:23:27 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:23:27 user nova-compute[75113]: FIRMWARE:
Oct 26 17:23:27 user nova-compute[75113]: No targets found.
Oct 26 17:23:27 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:23:27 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:23:27 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa954691-ef68-443e-b632-bff501339ca8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6726ec22-c82b-484f-a61a-9516896b497f]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:23:27 user nova-compute[75113]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d (non-flash)
Oct 26 17:23:27 user nova-compute[75113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 (non-flash)
Oct 26 17:23:27 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:23:27 user nova-compute[75113]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d (non-flash)
Oct 26 17:23:27 user nova-compute[75113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 (non-flash)
Oct 26 17:23:27 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914147880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d'): ({'sdc'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Removing single pathed devices sdc {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d2b5a3-bd0c-4fce-a624-33bf8aa76de9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f5ea3b-b6a7-4665-9eb8-136ecd210557]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Flushing IO for device /dev/sdc {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd902a58-2e84-4be0-ab23-6f6deb423109]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61697df-5ff2-4c96-9762-ad58f2e81193]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b5dda5-a8e0-40e1-a27f-befd7ca68a10]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d22e63-f58e-46f2-923b-1ec8d9910c0e]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d, portal: 172.16.0.220,3260]
Oct 26 17:23:27 user nova-compute[75113]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d, portal: 172.16.0.220,3260] successful.
Oct 26 17:23:27 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddd441d-925d-4add-b351-731ec44ab09d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caa8528-6a75-4788-ba20-91d957d8dba1]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] <== disconnect_volume: return (334ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:23:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:23:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:28 user nova-compute[75113]: DEBUG nova.objects.instance [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lazy-loading 'flavor' on Instance uuid 884b3704-d20c-4207-9a67-3552df05b6a2 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:23:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-31ad5305-e8a9-468b-ae2a-346743520fca tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "884b3704-d20c-4207-9a67-3552df05b6a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.844s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:23:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:34 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 183f0ea9-141a-4df8-98c9-db68420a5bbe is timed out.
Oct 26 17:23:34 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully detached device vdb from instance 183f0ea9-141a-4df8-98c9-db68420a5bbe from the live domain config.
Oct 26 17:23:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huKimcXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:23:34 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2802282-8b0c-4069-917c-077afd109f8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:23:34 user nova-compute[75113]: No targets found.
Oct 26 17:23:34 user nova-compute[75113]: iSNS:
Oct 26 17:23:34 user nova-compute[75113]: No targets found.
Oct 26 17:23:34 user nova-compute[75113]: STATIC:
Oct 26 17:23:34 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb
Oct 26 17:23:34 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:23:34 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:23:34 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9
Oct 26 17:23:34 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:23:34 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:23:34 user nova-compute[75113]: FIRMWARE:
Oct 26 17:23:34 user nova-compute[75113]: No targets found.
Oct 26 17:23:34 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:23:34 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:23:34 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8552fc3-a4d4-4172-9726-4bb213bebc02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad63b33-6d32-4501-9325-e2a3a264f526]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:23:34 user nova-compute[75113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 (non-flash)
Oct 26 17:23:34 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb (non-flash)
Oct 26 17:23:34 user nova-compute[75113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 (non-flash)
Oct 26 17:23:34 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f492c1d2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a2c9ff-23bc-49ea-a972-b07bec7b2163]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7644f358-4a88-4e31-bcab-6afb873d34c8]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca573246-c359-42d4-96db-d8361a3eb301]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[891fa3be-8dd4-40e6-a33c-781ce9ad4022]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d9fafe-a288-4958-8144-8df4f77fa73a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cadfd88-2d93-473d-9b81-0051115d6f07]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb, portal: 172.16.0.220,3260]
Oct 26 17:23:35 user nova-compute[75113]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb, portal: 172.16.0.220,3260] successful.
Oct 26 17:23:35 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9777e0b-48dc-4a2a-9df2-a1346d7c3feb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:35 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b257cd67-d479-40d8-a673-7bb27c7b88ea]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:23:35 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] <== disconnect_volume: return (314ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:23:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:23:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:35 user nova-compute[75113]: DEBUG nova.objects.instance [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'flavor' on Instance uuid 183f0ea9-141a-4df8-98c9-db68420a5bbe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:23:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-07021394-0302-482b-91d7-6a01dc1ce652 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.808s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:23:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:23:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:23:36 user nova-compute[75113]: INFO nova.compute.manager [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Detaching volume 14139a2c-e9a3-4b26-96bb-1cf919d916d9
Oct 26 17:23:37 user nova-compute[75113]: INFO nova.virt.block_device [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Attempting to driver detach volume 14139a2c-e9a3-4b26-96bb-1cf919d916d9 from mountpoint /dev/vdc
Oct 26 17:23:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Attempting to detach device vdc from instance 183f0ea9-141a-4df8-98c9-db68420a5bbe from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:23:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:23:37 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:23:37 user nova-compute[75113]:   <source dev="/dev/sdd"/>
Oct 26 17:23:37 user nova-compute[75113]:   <target dev="vdc" bus="virtio"/>
Oct 26 17:23:37 user nova-compute[75113]:   <serial>14139a2c-e9a3-4b26-96bb-1cf919d916d9</serial>
Oct 26 17:23:37 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 17:23:37 user nova-compute[75113]: </disk>
Oct 26 17:23:37 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:23:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully detached device vdc from instance 183f0ea9-141a-4df8-98c9-db68420a5bbe from the persistent domain config.
Oct 26 17:23:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 183f0ea9-141a-4df8-98c9-db68420a5bbe from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:23:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:23:37 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:23:37 user nova-compute[75113]:   <source dev="/dev/sdd"/>
Oct 26 17:23:37 user nova-compute[75113]:   <target dev="vdc" bus="virtio"/>
Oct 26 17:23:37 user nova-compute[75113]:   <serial>14139a2c-e9a3-4b26-96bb-1cf919d916d9</serial>
Oct 26 17:23:37 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 17:23:37 user nova-compute[75113]: </disk>
Oct 26 17:23:37 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:23:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 183f0ea9-141a-4df8-98c9-db68420a5bbe {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:23:38 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:23:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "3bde34c7-f234-4c16-b631-224c029ba6e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:23:47 user nova-compute[75113]: INFO nova.compute.claims [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Claim successful on node user
Oct 26 17:23:47 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:23:47 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:23:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG nova.policy [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5efe78e0cd34414853f640e4c850e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309b039fa49c4e399504dcdcff86724e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:23:47 user nova-compute[75113]: INFO nova.virt.block_device [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Booting with volume 9aedb1cc-553c-461e-919f-f712e7e122ad at /dev/vda
Oct 26 17:23:47 user nova-compute[75113]: DEBUG os_brick.utils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[59442997-8a78-42fa-a65a-ccf97258aedd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a54dcd-8ca1-4c3a-8dd3-3144407310be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c572b5d-17ae-419d-8d0e-6885d53669c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a8995e-dc73-4529-be64-9a48ace7345d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:23:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:23:48 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:23:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c994339f-de41-4dc1-afed-cba0cf10a774]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:23:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:23:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:23:48 user nova-compute[75113]: DEBUG os_brick.utils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:23:48 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating existing volume attachment record: e3a8a584-1741-4d05-ae7f-2f9fe1b09973 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:23:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Successfully created port: 6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Successfully updated port: 6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquired lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-68e2bdd6-d587-4c9a-819b-1032483a5d35 req-6a69578c-4e37-4978-a4dd-12436758b71a service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-changed-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-68e2bdd6-d587-4c9a-819b-1032483a5d35 req-6a69578c-4e37-4978-a4dd-12436758b71a service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Refreshing instance network info cache due to event network-changed-6af72c21-9dc2-4a66-b0fe-792b2ff617fe. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-68e2bdd6-d587-4c9a-819b-1032483a5d35 req-6a69578c-4e37-4978-a4dd-12436758b71a service nova] Acquiring lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating instance_info_cache with network_info: [{"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Releasing lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Instance network_info: |[{"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-68e2bdd6-d587-4c9a-819b-1032483a5d35 req-6a69578c-4e37-4978-a4dd-12436758b71a service nova] Acquired lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG nova.network.neutron [req-68e2bdd6-d587-4c9a-819b-1032483a5d35 req-6a69578c-4e37-4978-a4dd-12436758b71a service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Refreshing network info cache for port 6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG nova.network.neutron [req-68e2bdd6-d587-4c9a-819b-1032483a5d35 req-6a69578c-4e37-4978-a4dd-12436758b71a service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updated VIF entry in instance network info cache for port 6af72c21-9dc2-4a66-b0fe-792b2ff617fe. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:23:49 user nova-compute[75113]: DEBUG nova.network.neutron [req-68e2bdd6-d587-4c9a-819b-1032483a5d35 req-6a69578c-4e37-4978-a4dd-12436758b71a service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating instance_info_cache with network_info: [{"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:23:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-68e2bdd6-d587-4c9a-819b-1032483a5d35 req-6a69578c-4e37-4978-a4dd-12436758b71a service nova] Releasing lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:23:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:57 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 183f0ea9-141a-4df8-98c9-db68420a5bbe is timed out.
Oct 26 17:23:57 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully detached device vdc from instance 183f0ea9-141a-4df8-98c9-db68420a5bbe from the live domain config.
Oct 26 17:23:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbXLZmug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:23:57 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab56130-7d19-4a63-8087-61b97051ef3f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:23:57 user nova-compute[75113]: No targets found.
Oct 26 17:23:57 user nova-compute[75113]: iSNS:
Oct 26 17:23:57 user nova-compute[75113]: No targets found.
Oct 26 17:23:57 user nova-compute[75113]: STATIC:
Oct 26 17:23:57 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9
Oct 26 17:23:57 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:23:57 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:23:57 user nova-compute[75113]: FIRMWARE:
Oct 26 17:23:57 user nova-compute[75113]: No targets found.
Oct 26 17:23:57 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:23:57 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:23:57 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1cb4b8-d565-4e2c-a001-0f6aff263b8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[225ad208-79c4-4cca-8272-001276e1a445]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 (non-flash)
Oct 26 17:23:57 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 (non-flash)
Oct 26 17:23:57 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49143db010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9'): ({'sdd'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Removing single pathed devices sdd {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[888a576e-4024-4a7d-b6c2-467d4fbec177]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-4fdb69b3-3884-491c-8c03-3f884d81c30d req-2630ec08-77c2-40a7-9e2a-9ecfb1719168 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Received event network-changed-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-4fdb69b3-3884-491c-8c03-3f884d81c30d req-2630ec08-77c2-40a7-9e2a-9ecfb1719168 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Refreshing instance network info cache due to event network-changed-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4fdb69b3-3884-491c-8c03-3f884d81c30d req-2630ec08-77c2-40a7-9e2a-9ecfb1719168 service nova] Acquiring lock "refresh_cache-884b3704-d20c-4207-9a67-3552df05b6a2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4fdb69b3-3884-491c-8c03-3f884d81c30d req-2630ec08-77c2-40a7-9e2a-9ecfb1719168 service nova] Acquired lock "refresh_cache-884b3704-d20c-4207-9a67-3552df05b6a2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG nova.network.neutron [req-4fdb69b3-3884-491c-8c03-3f884d81c30d req-2630ec08-77c2-40a7-9e2a-9ecfb1719168 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Refreshing network info cache for port 4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ec8865-fe42-48b0-906a-299bab53282e]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Flushing IO for device /dev/sdd {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cc6984-ed36-4f96-acd6-9ef45a35c3a4]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e65d5da-5989-4fe6-a0a7-992f6e473ae9]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] SCSI volumes sdd have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c78f99-2d55-47db-8239-b40810f6204d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "884b3704-d20c-4207-9a67-3552df05b6a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "884b3704-d20c-4207-9a67-3552df05b6a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:23:57 user nova-compute[75113]: INFO nova.compute.manager [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Terminating instance
Oct 26 17:23:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[748d9105-4a6e-4014-aae5-e91b8b3c6142]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9, portal: 172.16.0.220,3260]
Oct 26 17:23:57 user nova-compute[75113]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9, portal: 172.16.0.220,3260] successful.
Oct 26 17:23:57 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14139a2c-e9a3-4b26-96bb-1cf919d916d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d224f7a5-1fa5-43ce-b4f8-af15a805fa87]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] <== disconnect_volume: return (323ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-e29fc30e-42b9-4c03-8e46-4a11a931406e req-00bdcef1-77bc-4b50-bd22-244be413c5b6 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Received event network-vif-unplugged-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e29fc30e-42b9-4c03-8e46-4a11a931406e req-00bdcef1-77bc-4b50-bd22-244be413c5b6 service nova] Acquiring lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e29fc30e-42b9-4c03-8e46-4a11a931406e req-00bdcef1-77bc-4b50-bd22-244be413c5b6 service nova] Lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e29fc30e-42b9-4c03-8e46-4a11a931406e req-00bdcef1-77bc-4b50-bd22-244be413c5b6 service nova] Lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-e29fc30e-42b9-4c03-8e46-4a11a931406e req-00bdcef1-77bc-4b50-bd22-244be413c5b6 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] No waiting events found dispatching network-vif-unplugged-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG nova.compute.manager [req-e29fc30e-42b9-4c03-8e46-4a11a931406e req-00bdcef1-77bc-4b50-bd22-244be413c5b6 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Received event network-vif-unplugged-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:58 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Instance destroyed successfully.
Oct 26 17:23:58 user nova-compute[75113]: DEBUG nova.objects.instance [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lazy-loading 'resources' on Instance uuid 884b3704-d20c-4207-9a67-3552df05b6a2 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:20:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1432880011',display_name='tempest-TestStampPattern-server-1432880011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1432880011',id=39,image_ref='91edd9b4-06ab-424e-b386-a849d89a8278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWHyhdWG4vODww4J36tjcUt2ICXtezA7tiJccfBwgDPh+GMN+tQKBdFq+33nqzyfrbTLq8kX7WTafkfAiBXerZ2BCl1jBxwv1h0P5P+b6z5qmRWoytp+RGBDhwGCxEyfQ==',key_name='tempest-TestStampPattern-754663238',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:20:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95d413c67bd3476cbfeb8e39af59e9ee',ramdisk_id='',reservation_id='r-0lj4qb4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fc80403d-8fbd-4836-8d01-89fa7aad8d7e',image_min_disk='1',image_min_ram='0',image_owner_id='95d413c67bd3476cbfeb8e39af59e9ee',image_owner_project_name='tempest-TestStampPattern-1797568490',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1797568490-project-member',image_user_id='cf60300c4d874a99a5a99bef82641993',owner_project_name='tempest-TestStampPattern-1797568490',owner_user_name='tempest-TestStampPattern-1797568490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:20:58Z,user_data=None,user_id='cf60300c4d874a99a5a99bef82641993',uuid=884b3704-d20c-4207-9a67-3552df05b6a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "address": "fa:16:3e:d9:33:a3", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2cadaf-b4", "ovs_interfaceid": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Converting VIF {"id": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "address": "fa:16:3e:d9:33:a3", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2cadaf-b4", "ovs_interfaceid": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=4f2cadaf-b488-450e-8d2b-76ba4adf9c0e,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2cadaf-b4') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG os_vif [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=4f2cadaf-b488-450e-8d2b-76ba4adf9c0e,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2cadaf-b4') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f2cadaf-b4, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f81bb439-c10a-4388-af6c-c32a7a272954) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:23:58 user nova-compute[75113]: INFO os_vif [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:33:a3,bridge_name='br-int',has_traffic_filtering=True,id=4f2cadaf-b488-450e-8d2b-76ba4adf9c0e,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2cadaf-b4')
Oct 26 17:23:58 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Deleting instance files /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2_del
Oct 26 17:23:58 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Deletion of /opt/stack/data/nova/instances/884b3704-d20c-4207-9a67-3552df05b6a2_del complete
Oct 26 17:23:58 user nova-compute[75113]: INFO nova.compute.manager [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 26 17:23:58 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-4fdb69b3-3884-491c-8c03-3f884d81c30d req-2630ec08-77c2-40a7-9e2a-9ecfb1719168 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Updated VIF entry in instance network info cache for port 4f2cadaf-b488-450e-8d2b-76ba4adf9c0e. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-4fdb69b3-3884-491c-8c03-3f884d81c30d req-2630ec08-77c2-40a7-9e2a-9ecfb1719168 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Updating instance_info_cache with network_info: [{"id": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "address": "fa:16:3e:d9:33:a3", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2cadaf-b4", "ovs_interfaceid": "4f2cadaf-b488-450e-8d2b-76ba4adf9c0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4fdb69b3-3884-491c-8c03-3f884d81c30d req-2630ec08-77c2-40a7-9e2a-9ecfb1719168 service nova] Releasing lock "refresh_cache-884b3704-d20c-4207-9a67-3552df05b6a2" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG nova.objects.instance [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'flavor' on Instance uuid 183f0ea9-141a-4df8-98c9-db68420a5bbe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:23:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-51443f9c-22e9-4155-b682-da2b8517e4c8 tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.898s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:23:59 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Took 0.50 seconds to deallocate network for instance.
Oct 26 17:23:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:23:59 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Deleted allocations for instance 884b3704-d20c-4207-9a67-3552df05b6a2
Oct 26 17:23:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-34e4bd63-3dc4-4045-a38a-30be69e03e3a tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "884b3704-d20c-4207-9a67-3552df05b6a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.815s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-aa1a600d-a8f0-460f-b6e2-32344606bf79 req-80b1383a-3691-4220-8c98-7d0a286b6dae service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Received event network-vif-deleted-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:23:59 user nova-compute[75113]: INFO nova.compute.manager [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Terminating instance
Oct 26 17:23:59 user nova-compute[75113]: DEBUG nova.compute.manager [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:23:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-5c0e41ed-214a-457f-9d7f-4ef35c5eeea5 req-89eac78d-9b85-48b2-ad80-612b36e07692 service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Received event network-vif-unplugged-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5c0e41ed-214a-457f-9d7f-4ef35c5eeea5 req-89eac78d-9b85-48b2-ad80-612b36e07692 service nova] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5c0e41ed-214a-457f-9d7f-4ef35c5eeea5 req-89eac78d-9b85-48b2-ad80-612b36e07692 service nova] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5c0e41ed-214a-457f-9d7f-4ef35c5eeea5 req-89eac78d-9b85-48b2-ad80-612b36e07692 service nova] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-5c0e41ed-214a-457f-9d7f-4ef35c5eeea5 req-89eac78d-9b85-48b2-ad80-612b36e07692 service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] No waiting events found dispatching network-vif-unplugged-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-5c0e41ed-214a-457f-9d7f-4ef35c5eeea5 req-89eac78d-9b85-48b2-ad80-612b36e07692 service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Received event network-vif-unplugged-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-d1304d02-ad77-4d09-876b-fd8f23c42c50 req-0ae34d41-cc03-41bb-859f-f5ab00cb4323 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Received event network-vif-plugged-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1304d02-ad77-4d09-876b-fd8f23c42c50 req-0ae34d41-cc03-41bb-859f-f5ab00cb4323 service nova] Acquiring lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1304d02-ad77-4d09-876b-fd8f23c42c50 req-0ae34d41-cc03-41bb-859f-f5ab00cb4323 service nova] Lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d1304d02-ad77-4d09-876b-fd8f23c42c50 req-0ae34d41-cc03-41bb-859f-f5ab00cb4323 service nova] Lock "884b3704-d20c-4207-9a67-3552df05b6a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-d1304d02-ad77-4d09-876b-fd8f23c42c50 req-0ae34d41-cc03-41bb-859f-f5ab00cb4323 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] No waiting events found dispatching network-vif-plugged-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:24:00 user nova-compute[75113]: WARNING nova.compute.manager [req-d1304d02-ad77-4d09-876b-fd8f23c42c50 req-0ae34d41-cc03-41bb-859f-f5ab00cb4323 service nova] [instance: 884b3704-d20c-4207-9a67-3552df05b6a2] Received unexpected event network-vif-plugged-4f2cadaf-b488-450e-8d2b-76ba4adf9c0e for instance with vm_state deleted and task_state None.
Oct 26 17:24:00 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Instance destroyed successfully.
Oct 26 17:24:00 user nova-compute[75113]: DEBUG nova.objects.instance [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lazy-loading 'resources' on Instance uuid 183f0ea9-141a-4df8-98c9-db68420a5bbe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:20:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-956791486',display_name='tempest-AttachVolumeTestJSON-server-956791486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-956791486',id=37,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzuE0QRAOClk/XLrbiky/zYfzFPJqi/Mrqof0qDhomsUhbOBsynBWDa5TcfrPpub67EtcN7dC3d6Xlacw58LRYxs7vkCYnlQwcl2eB16y2MVn/imZ+ww5+hPbR0kjBVvw==',key_name='tempest-keypair-1320210309',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:20:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecfe1e4023f641d6b492c7a0d0fc033b',ramdisk_id='',reservation_id='r-3g60m8aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1430222675',owner_user_name='tempest-AttachVolumeTestJSON-1430222675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:20:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b04592754c6c406e9d550e9036fe9ea7',uuid=183f0ea9-141a-4df8-98c9-db68420a5bbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "address": "fa:16:3e:2e:29:e3", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991d39e0-d3", "ovs_interfaceid": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converting VIF {"id": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "address": "fa:16:3e:2e:29:e3", "network": {"id": "8b59cdb0-813e-4478-acb8-cce822077002", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-30951268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecfe1e4023f641d6b492c7a0d0fc033b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991d39e0-d3", "ovs_interfaceid": "991d39e0-d395-48e6-b6d9-e1d9868b1ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:29:e3,bridge_name='br-int',has_traffic_filtering=True,id=991d39e0-d395-48e6-b6d9-e1d9868b1ca9,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991d39e0-d3') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG os_vif [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:29:e3,bridge_name='br-int',has_traffic_filtering=True,id=991d39e0-d395-48e6-b6d9-e1d9868b1ca9,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991d39e0-d3') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap991d39e0-d3, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=182fd31a-d3e0-427a-b759-65d573502d72) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:00 user nova-compute[75113]: INFO os_vif [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:29:e3,bridge_name='br-int',has_traffic_filtering=True,id=991d39e0-d395-48e6-b6d9-e1d9868b1ca9,network=Network(8b59cdb0-813e-4478-acb8-cce822077002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991d39e0-d3')
Oct 26 17:24:00 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Deleting instance files /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe_del
Oct 26 17:24:00 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Deletion of /opt/stack/data/nova/instances/183f0ea9-141a-4df8-98c9-db68420a5bbe_del complete
Oct 26 17:24:00 user nova-compute[75113]: INFO nova.compute.manager [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 26 17:24:00 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:24:00 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:24:01 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:24:01 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Took 0.62 seconds to deallocate network for instance.
Oct 26 17:24:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:01 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:24:01 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:24:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:01 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Deleted allocations for instance 183f0ea9-141a-4df8-98c9-db68420a5bbe
Oct 26 17:24:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-f27a8070-b90f-4716-b193-af53c6b2e11b tempest-AttachVolumeTestJSON-1430222675 tempest-AttachVolumeTestJSON-1430222675-project-member] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.799s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:01 user nova-compute[75113]: DEBUG nova.compute.manager [req-b4eaf4e5-16b3-4455-8c6f-c423ab3294a0 req-98a5c2be-e711-451e-a9c3-46f741d8a2fb service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Received event network-vif-deleted-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:24:02 user nova-compute[75113]: DEBUG nova.compute.manager [req-d71c4b54-dc62-4274-8247-6939da899b26 req-3bba574f-8b0f-4b15-8449-be412c1c9674 service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Received event network-vif-plugged-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:24:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d71c4b54-dc62-4274-8247-6939da899b26 req-3bba574f-8b0f-4b15-8449-be412c1c9674 service nova] Acquiring lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d71c4b54-dc62-4274-8247-6939da899b26 req-3bba574f-8b0f-4b15-8449-be412c1c9674 service nova] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d71c4b54-dc62-4274-8247-6939da899b26 req-3bba574f-8b0f-4b15-8449-be412c1c9674 service nova] Lock "183f0ea9-141a-4df8-98c9-db68420a5bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:02 user nova-compute[75113]: DEBUG nova.compute.manager [req-d71c4b54-dc62-4274-8247-6939da899b26 req-3bba574f-8b0f-4b15-8449-be412c1c9674 service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] No waiting events found dispatching network-vif-plugged-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:24:02 user nova-compute[75113]: WARNING nova.compute.manager [req-d71c4b54-dc62-4274-8247-6939da899b26 req-3bba574f-8b0f-4b15-8449-be412c1c9674 service nova] [instance: 183f0ea9-141a-4df8-98c9-db68420a5bbe] Received unexpected event network-vif-plugged-991d39e0-d395-48e6-b6d9-e1d9868b1ca9 for instance with vm_state deleted and task_state None.
Oct 26 17:24:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:24:07 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Creating image(s)
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Ensure instance console log exists: /opt/stack/data/nova/instances/3bde34c7-f234-4c16-b631-224c029ba6e8/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Start _get_guest_xml network_info=[{"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e3a8a584-1741-4d05-ae7f-2f9fe1b09973', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXDzWLga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3bde34c7-f234-4c16-b631-224c029ba6e8', 'attached_at': '', 'detached_at': '', 'volume_id': '9aedb1cc-553c-461e-919f-f712e7e122ad', 'serial': '9aedb1cc-553c-461e-919f-f712e7e122ad'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:24:07 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:24:07 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXDzWLga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:24:07 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:24:07 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:24:07 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4797f482-45da-48ff-a077-6b008463c056]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:24:07 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b780e6e-c448-40dd-9d8c-af0bc4a08344]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad] added
Oct 26 17:24:07 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6263c378-da69-4d9a-b6ed-03629929fecf]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[999578fb-c4fb-40c0-ba5c-685167baacf7]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXDzWLga {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXDzWLga" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb988952-7486-45bb-85dd-8934843b259c]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vXDzWLga'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d06bc73-b1b4-4174-a041-57997e73065c]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86d857c-1b90-47b8-9f01-7f582aec52bd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:24:07 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:24:07 user nova-compute[75113]:  {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:24:07 user nova-compute[75113]: WARNING os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 17:24:07 user nova-compute[75113]: 
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d6609f-8900-4970-8752-44f9a1e82bd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260]
Oct 26 17:24:07 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260] successful.
Oct 26 17:24:07 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d4509e-900f-445b-8a2c-4976ee85fa93]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad9cdbd-579b-496f-9358-f7bf20a4e6d8]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:24:07 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:24:07 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b435ec-a3a2-47d6-b216-1e861c067532]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:07 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXDzWLga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23532616561356233', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532616561356233', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:23:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1599500593',display_name='tempest-TestShelveInstance-server-1599500593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1599500593',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWVYz4AZfs9UYgwkwxK7OMuSZTVhnIn/EUPYm9pX6bRnq6gwN6QncrGykfiZNHRCcFcYVdnOMJQERLBZ6bzbFz5klneMgbu61zTsYgzkwt+J+lV920+/sRSLOz+P5SYPg==',key_name='tempest-TestShelveInstance-1332116264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='309b039fa49c4e399504dcdcff86724e',ramdisk_id='',reservation_id='r-t2nawjxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1069964257',owner_user_name='tempest-TestShelveInstance-1069964257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:23:48Z,user_data=None,user_id='d5efe78e0cd34414853f640e4c850e5d',uuid=3bde34c7-f234-4c16-b631-224c029ba6e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Converting VIF {"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG nova.objects.instance [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bde34c7-f234-4c16-b631-224c029ba6e8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:24:08 user nova-compute[75113]:   <uuid>3bde34c7-f234-4c16-b631-224c029ba6e8</uuid>
Oct 26 17:24:08 user nova-compute[75113]:   <name>instance-00000028</name>
Oct 26 17:24:08 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:24:08 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:24:08 user nova-compute[75113]:   <metadata>
Oct 26 17:24:08 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:24:08 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:24:08 user nova-compute[75113]:       <nova:name>tempest-TestShelveInstance-server-1599500593</nova:name>
Oct 26 17:24:08 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:24:07</nova:creationTime>
Oct 26 17:24:08 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:24:08 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:24:08 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:24:08 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:24:08 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:24:08 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:24:08 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:24:08 user nova-compute[75113]:       <nova:owner>
Oct 26 17:24:08 user nova-compute[75113]:         <nova:user uuid="d5efe78e0cd34414853f640e4c850e5d">tempest-TestShelveInstance-1069964257-project-member</nova:user>
Oct 26 17:24:08 user nova-compute[75113]:         <nova:project uuid="309b039fa49c4e399504dcdcff86724e">tempest-TestShelveInstance-1069964257</nova:project>
Oct 26 17:24:08 user nova-compute[75113]:       </nova:owner>
Oct 26 17:24:08 user nova-compute[75113]:       <nova:ports>
Oct 26 17:24:08 user nova-compute[75113]:         <nova:port uuid="6af72c21-9dc2-4a66-b0fe-792b2ff617fe">
Oct 26 17:24:08 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 17:24:08 user nova-compute[75113]:         </nova:port>
Oct 26 17:24:08 user nova-compute[75113]:       </nova:ports>
Oct 26 17:24:08 user nova-compute[75113]:     </nova:instance>
Oct 26 17:24:08 user nova-compute[75113]:   </metadata>
Oct 26 17:24:08 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:24:08 user nova-compute[75113]:     <system>
Oct 26 17:24:08 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:24:08 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:24:08 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:24:08 user nova-compute[75113]:       <entry name="serial">3bde34c7-f234-4c16-b631-224c029ba6e8</entry>
Oct 26 17:24:08 user nova-compute[75113]:       <entry name="uuid">3bde34c7-f234-4c16-b631-224c029ba6e8</entry>
Oct 26 17:24:08 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:24:08 user nova-compute[75113]:     </system>
Oct 26 17:24:08 user nova-compute[75113]:   </sysinfo>
Oct 26 17:24:08 user nova-compute[75113]:   <os>
Oct 26 17:24:08 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:24:08 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:24:08 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:24:08 user nova-compute[75113]:   </os>
Oct 26 17:24:08 user nova-compute[75113]:   <features>
Oct 26 17:24:08 user nova-compute[75113]:     <acpi/>
Oct 26 17:24:08 user nova-compute[75113]:     <apic/>
Oct 26 17:24:08 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:24:08 user nova-compute[75113]:   </features>
Oct 26 17:24:08 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:24:08 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:24:08 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:24:08 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:24:08 user nova-compute[75113]:   </clock>
Oct 26 17:24:08 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:24:08 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:24:08 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:24:08 user nova-compute[75113]:   </cpu>
Oct 26 17:24:08 user nova-compute[75113]:   <devices>
Oct 26 17:24:08 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:24:08 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:24:08 user nova-compute[75113]:       <source dev="/dev/sdb"/>
Oct 26 17:24:08 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:24:08 user nova-compute[75113]:       <serial>9aedb1cc-553c-461e-919f-f712e7e122ad</serial>
Oct 26 17:24:08 user nova-compute[75113]:     </disk>
Oct 26 17:24:08 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:24:08 user nova-compute[75113]:       <mac address="fa:16:3e:bf:82:80"/>
Oct 26 17:24:08 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:24:08 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:24:08 user nova-compute[75113]:       <target dev="tap6af72c21-9d"/>
Oct 26 17:24:08 user nova-compute[75113]:     </interface>
Oct 26 17:24:08 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:24:08 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/3bde34c7-f234-4c16-b631-224c029ba6e8/console.log" append="off"/>
Oct 26 17:24:08 user nova-compute[75113]:     </serial>
Oct 26 17:24:08 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:24:08 user nova-compute[75113]:     <video>
Oct 26 17:24:08 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:24:08 user nova-compute[75113]:     </video>
Oct 26 17:24:08 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:24:08 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:24:08 user nova-compute[75113]:     </rng>
Oct 26 17:24:08 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:24:08 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:24:08 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:24:08 user nova-compute[75113]:     </memballoon>
Oct 26 17:24:08 user nova-compute[75113]:   </devices>
Oct 26 17:24:08 user nova-compute[75113]: </domain>
Oct 26 17:24:08 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:23:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1599500593',display_name='tempest-TestShelveInstance-server-1599500593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1599500593',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWVYz4AZfs9UYgwkwxK7OMuSZTVhnIn/EUPYm9pX6bRnq6gwN6QncrGykfiZNHRCcFcYVdnOMJQERLBZ6bzbFz5klneMgbu61zTsYgzkwt+J+lV920+/sRSLOz+P5SYPg==',key_name='tempest-TestShelveInstance-1332116264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='309b039fa49c4e399504dcdcff86724e',ramdisk_id='',reservation_id='r-t2nawjxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1069964257',owner_user_name='tempest-TestShelveInstance-1069964257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:23:48Z,user_data=None,user_id='d5efe78e0cd34414853f640e4c850e5d',uuid=3bde34c7-f234-4c16-b631-224c029ba6e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Converting VIF {"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG os_vif [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fb736d5-fc49-5944-9af1-d4a4941a2915', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6af72c21-9d, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6af72c21-9d, col_values=(('qos', UUID('fe1c7a11-f814-4c61-8c50-e3107d4d76b7')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6af72c21-9d, col_values=(('external_ids', {'iface-id': '6af72c21-9dc2-4a66-b0fe-792b2ff617fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:82:80', 'vm-uuid': '3bde34c7-f234-4c16-b631-224c029ba6e8'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:08 user nova-compute[75113]: INFO os_vif [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d')
Oct 26 17:24:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:24:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] No VIF found with MAC fa:16:3e:bf:82:80, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:24:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-dc868260-c9f0-4b14-959d-70051401eaad req-6e37dd5c-efca-47f7-ae71-9042cdcf8709 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:24:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dc868260-c9f0-4b14-959d-70051401eaad req-6e37dd5c-efca-47f7-ae71-9042cdcf8709 service nova] Acquiring lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dc868260-c9f0-4b14-959d-70051401eaad req-6e37dd5c-efca-47f7-ae71-9042cdcf8709 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-dc868260-c9f0-4b14-959d-70051401eaad req-6e37dd5c-efca-47f7-ae71-9042cdcf8709 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-dc868260-c9f0-4b14-959d-70051401eaad req-6e37dd5c-efca-47f7-ae71-9042cdcf8709 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] No waiting events found dispatching network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:24:10 user nova-compute[75113]: WARNING nova.compute.manager [req-dc868260-c9f0-4b14-959d-70051401eaad req-6e37dd5c-efca-47f7-ae71-9042cdcf8709 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received unexpected event network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe for instance with vm_state building and task_state spawning.
Oct 26 17:24:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:24:12 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Instance spawned successfully.
Oct 26 17:24:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG nova.compute.manager [req-f405af12-208d-4465-bc9e-d271b7cb106e req-f147a33a-ed4c-4c6d-9371-3538286fdad0 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f405af12-208d-4465-bc9e-d271b7cb106e req-f147a33a-ed4c-4c6d-9371-3538286fdad0 service nova] Acquiring lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f405af12-208d-4465-bc9e-d271b7cb106e req-f147a33a-ed4c-4c6d-9371-3538286fdad0 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f405af12-208d-4465-bc9e-d271b7cb106e req-f147a33a-ed4c-4c6d-9371-3538286fdad0 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG nova.compute.manager [req-f405af12-208d-4465-bc9e-d271b7cb106e req-f147a33a-ed4c-4c6d-9371-3538286fdad0 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] No waiting events found dispatching network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:24:12 user nova-compute[75113]: WARNING nova.compute.manager [req-f405af12-208d-4465-bc9e-d271b7cb106e req-f147a33a-ed4c-4c6d-9371-3538286fdad0 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received unexpected event network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe for instance with vm_state building and task_state spawning.
Oct 26 17:24:12 user nova-compute[75113]: INFO nova.compute.manager [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Took 5.14 seconds to spawn the instance on the hypervisor.
Oct 26 17:24:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:24:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:12 user nova-compute[75113]: INFO nova.compute.manager [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Took 25.03 seconds to build instance.
Oct 26 17:24:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6019ec83-865a-44ae-b0c7-1f6ec1754653 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.132s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:15 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:24:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:24:19 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:24:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:24:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:24:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:24:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:23 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:24:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:24:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:24:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:24 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:24:24 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:24:24 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8592MB free_disk=25.022266387939453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:24:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:24 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:24:24 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 3bde34c7-f234-4c16-b631-224c029ba6e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:24:24 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:24:24 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:24:24 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:24:24 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:24:24 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:24:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:27 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:24:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:24:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 17:24:27 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:24:27 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:24:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:24:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:36 user nova-compute[75113]: INFO nova.compute.manager [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Unshelving
Oct 26 17:24:36 user nova-compute[75113]: INFO nova.virt.block_device [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Booting with volume 9a4b6f77-b530-478d-aace-04b620a8107b at /dev/vdc
Oct 26 17:24:36 user nova-compute[75113]: DEBUG os_brick.utils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:24:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8649416a-ab20-4c32-a7f3-85a82979c5e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d98f653-b17b-4190-8dec-2efd224e6d0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcd0c8e-4bac-42ef-83de-b868c68c8620]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:36 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7673baaa-4eed-4168-9183-bdc4a2861934]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:24:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:24:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:24:37 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:24:37 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5407a28b-44b5-4ad9-a4b2-0e8611350414]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:24:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:24:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:24:37 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:24:37 user nova-compute[75113]: DEBUG os_brick.utils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:24:37 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updating existing volume attachment record: a385df06-794e-4df0-ad63-cca0a8b44cd6 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:24:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:39 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:24:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:46 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:24:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:24:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:24:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:24:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:24:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:55 user nova-compute[75113]: DEBUG nova.objects.instance [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'pci_requests' on Instance uuid f642e634-0efc-4ed2-aa00-ba2d3979b353 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:24:56 user nova-compute[75113]: DEBUG nova.objects.instance [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'numa_topology' on Instance uuid f642e634-0efc-4ed2-aa00-ba2d3979b353 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:24:56 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:24:56 user nova-compute[75113]: INFO nova.compute.claims [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Claim successful on node user
Oct 26 17:24:56 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:24:56 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:24:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:56 user nova-compute[75113]: INFO nova.network.neutron [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updating port a579d831-4c13-4c14-bb83-d0eae63bfecc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 17:24:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:24:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquired lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:24:56 user nova-compute[75113]: DEBUG nova.network.neutron [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-a3547bc9-badc-4c4b-a7cc-a08ee113d77e req-b91458c3-7bfc-4df8-b037-8f7684e43ae0 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-changed-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-a3547bc9-badc-4c4b-a7cc-a08ee113d77e req-b91458c3-7bfc-4df8-b037-8f7684e43ae0 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Refreshing instance network info cache due to event network-changed-a579d831-4c13-4c14-bb83-d0eae63bfecc. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a3547bc9-badc-4c4b-a7cc-a08ee113d77e req-b91458c3-7bfc-4df8-b037-8f7684e43ae0 service nova] Acquiring lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG nova.network.neutron [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updating instance_info_cache with network_info: [{"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Releasing lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:24:57 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Creating image(s)
Oct 26 17:24:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "/opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "/opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "/opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG nova.objects.instance [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'trusted_certs' on Instance uuid f642e634-0efc-4ed2-aa00-ba2d3979b353 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a3547bc9-badc-4c4b-a7cc-a08ee113d77e req-b91458c3-7bfc-4df8-b037-8f7684e43ae0 service nova] Acquired lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG nova.network.neutron [req-a3547bc9-badc-4c4b-a7cc-a08ee113d77e req-b91458c3-7bfc-4df8-b037-8f7684e43ae0 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Refreshing network info cache for port a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG nova.objects.base [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Object Instance<f642e634-0efc-4ed2-aa00-ba2d3979b353> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "da914275af8a3c8dbfd1adccce6b0188a764e171" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "da914275af8a3c8dbfd1adccce6b0188a764e171" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171.part --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:24:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171.part --force-share --output=json" returned: 0 in 0.256s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:58 user nova-compute[75113]: DEBUG nova.virt.images [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] 0bb9e4df-d74b-4a38-91b7-43b9d1ecddaf was qcow2, converting to raw {{(pid=75113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 17:24:58 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 17:24:58 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171.part /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171.converted {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-a3547bc9-badc-4c4b-a7cc-a08ee113d77e req-b91458c3-7bfc-4df8-b037-8f7684e43ae0 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updated VIF entry in instance network info cache for port a579d831-4c13-4c14-bb83-d0eae63bfecc. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:24:58 user nova-compute[75113]: DEBUG nova.network.neutron [req-a3547bc9-badc-4c4b-a7cc-a08ee113d77e req-b91458c3-7bfc-4df8-b037-8f7684e43ae0 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updating instance_info_cache with network_info: [{"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:24:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-a3547bc9-badc-4c4b-a7cc-a08ee113d77e req-b91458c3-7bfc-4df8-b037-8f7684e43ae0 service nova] Releasing lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:24:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171.part /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171.converted" returned: 0 in 0.559s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171.converted --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "da914275af8a3c8dbfd1adccce6b0188a764e171" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.137s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:24:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171 --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "da914275af8a3c8dbfd1adccce6b0188a764e171" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:24:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "da914275af8a3c8dbfd1adccce6b0188a764e171" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:24:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:24:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171 --force-share --output=json" returned: 0 in 0.192s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:24:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171,backing_fmt=raw /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171,backing_fmt=raw /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk 1073741824" returned: 0 in 0.056s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "da914275af8a3c8dbfd1adccce6b0188a764e171" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da914275af8a3c8dbfd1adccce6b0188a764e171 --force-share --output=json" returned: 0 in 0.192s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:00 user nova-compute[75113]: DEBUG nova.objects.instance [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'migration_context' on Instance uuid f642e634-0efc-4ed2-aa00-ba2d3979b353 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:25:00 user nova-compute[75113]: DEBUG nova.objects.base [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Object Instance<f642e634-0efc-4ed2-aa00-ba2d3979b353> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:25:00 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Rebasing disk image.
Oct 26 17:25:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.173s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 -F raw /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 -F raw /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk" returned: 0 in 2.627s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Ensure instance console log exists: /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Start _get_guest_xml network_info=[{"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='124cdc1a6ba1928f95fd8699bbb49b73',container_format='bare',created_at=2023-10-26T17:22:44Z,direct_url=<?>,disk_format='qcow2',id=0bb9e4df-d74b-4a38-91b7-43b9d1ecddaf,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1601727451-shelved',owner='2b425dca1e9645ad99fea4b666b01fab',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T17:22:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a385df06-794e-4df0-ad63-cca0a8b44cd6', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USOZEgde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f642e634-0efc-4ed2-aa00-ba2d3979b353', 'attached_at': '', 'detached_at': '', 'volume_id': '9a4b6f77-b530-478d-aace-04b620a8107b', 'serial': '9a4b6f77-b530-478d-aace-04b620a8107b'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:25:03 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:25:03 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='124cdc1a6ba1928f95fd8699bbb49b73',container_format='bare',created_at=2023-10-26T17:22:44Z,direct_url=<?>,disk_format='qcow2',id=0bb9e4df-d74b-4a38-91b7-43b9d1ecddaf,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1601727451-shelved',owner='2b425dca1e9645ad99fea4b666b01fab',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T17:22:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.objects.instance [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'vcpu_model' on Instance uuid f642e634-0efc-4ed2-aa00-ba2d3979b353 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.objects.base [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Object Instance<f642e634-0efc-4ed2-aa00-ba2d3979b353> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USOZEgde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:25:03 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:25:03 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:25:03 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[98762e03-62cc-4efd-9d12-25dad44b1ed6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:25:03 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae18fc5d-4cd1-4fe5-9153-be5ebd504c7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b] added
Oct 26 17:25:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[922f7a96-fe0b-4930-937a-075e9f4de0d3]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[65622566-103a-4308-970d-a998df6611d2]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USOZEgde {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USOZEgde" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94fb62d-6ab3-4e78-bb7f-74ddf79a7e17]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'USOZEgde'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb4ad96-16fe-4681-9d2a-508a981989fc]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[17609947-6b56-447a-996e-dd9b119cfe86]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:25:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:25:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa95e00-42e0-47da-8d02-af9d45caec24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b, portal: 172.16.0.220,3260]
Oct 26 17:25:03 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b, portal: 172.16.0.220,3260] successful.
Oct 26 17:25:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4851bf83-8711-4c7b-b5b9-59891337cddd]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[986a5abb-1622-42f2-8330-920b149d170a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:25:03 user nova-compute[75113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b (non-flash)
Oct 26 17:25:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:25:03 user nova-compute[75113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b (non-flash)
Oct 26 17:25:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c7e819-0bee-4edc-a3b1-c8a6779c8606]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USOZEgde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:25:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23134313763376137', 'path': '/dev/sdc'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134313763376137', 'path': '/dev/sdc'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1601727451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1601727451',id=38,image_ref='0bb9e4df-d74b-4a38-91b7-43b9d1ecddaf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1190114021',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:20:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b425dca1e9645ad99fea4b666b01fab',ramdisk_id='',reservation_id='r-uwmu4xiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1688117037',owner_user_name='tempest-AttachVolumeShelveTestJSON-1688117037-project-member',shelved_at='2023-10-26T17:22:48.949196',shelved_host='user',shelved_image_id='0bb9e4df-d74b-4a38-91b7-43b9d1ecddaf'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:24:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b16af3affdf47f596f944cb83f772e9',uuid=f642e634-0efc-4ed2-aa00-ba2d3979b353,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converting VIF {"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'pci_devices' on Instance uuid f642e634-0efc-4ed2-aa00-ba2d3979b353 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG nova.objects.base [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Object Instance<f642e634-0efc-4ed2-aa00-ba2d3979b353> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:25:04 user nova-compute[75113]:   <uuid>f642e634-0efc-4ed2-aa00-ba2d3979b353</uuid>
Oct 26 17:25:04 user nova-compute[75113]:   <name>instance-00000026</name>
Oct 26 17:25:04 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:25:04 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:25:04 user nova-compute[75113]:   <metadata>
Oct 26 17:25:04 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:25:04 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:25:04 user nova-compute[75113]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1601727451</nova:name>
Oct 26 17:25:04 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:25:03</nova:creationTime>
Oct 26 17:25:04 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:25:04 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:25:04 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:25:04 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:25:04 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:25:04 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:25:04 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:25:04 user nova-compute[75113]:       <nova:owner>
Oct 26 17:25:04 user nova-compute[75113]:         <nova:user uuid="6b16af3affdf47f596f944cb83f772e9">tempest-AttachVolumeShelveTestJSON-1688117037-project-member</nova:user>
Oct 26 17:25:04 user nova-compute[75113]:         <nova:project uuid="2b425dca1e9645ad99fea4b666b01fab">tempest-AttachVolumeShelveTestJSON-1688117037</nova:project>
Oct 26 17:25:04 user nova-compute[75113]:       </nova:owner>
Oct 26 17:25:04 user nova-compute[75113]:       <nova:root type="image" uuid="0bb9e4df-d74b-4a38-91b7-43b9d1ecddaf"/>
Oct 26 17:25:04 user nova-compute[75113]:       <nova:ports>
Oct 26 17:25:04 user nova-compute[75113]:         <nova:port uuid="a579d831-4c13-4c14-bb83-d0eae63bfecc">
Oct 26 17:25:04 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 17:25:04 user nova-compute[75113]:         </nova:port>
Oct 26 17:25:04 user nova-compute[75113]:       </nova:ports>
Oct 26 17:25:04 user nova-compute[75113]:     </nova:instance>
Oct 26 17:25:04 user nova-compute[75113]:   </metadata>
Oct 26 17:25:04 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:25:04 user nova-compute[75113]:     <system>
Oct 26 17:25:04 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:25:04 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:25:04 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:25:04 user nova-compute[75113]:       <entry name="serial">f642e634-0efc-4ed2-aa00-ba2d3979b353</entry>
Oct 26 17:25:04 user nova-compute[75113]:       <entry name="uuid">f642e634-0efc-4ed2-aa00-ba2d3979b353</entry>
Oct 26 17:25:04 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:25:04 user nova-compute[75113]:     </system>
Oct 26 17:25:04 user nova-compute[75113]:   </sysinfo>
Oct 26 17:25:04 user nova-compute[75113]:   <os>
Oct 26 17:25:04 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:25:04 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:25:04 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:25:04 user nova-compute[75113]:   </os>
Oct 26 17:25:04 user nova-compute[75113]:   <features>
Oct 26 17:25:04 user nova-compute[75113]:     <acpi/>
Oct 26 17:25:04 user nova-compute[75113]:     <apic/>
Oct 26 17:25:04 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:25:04 user nova-compute[75113]:   </features>
Oct 26 17:25:04 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:25:04 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:25:04 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:25:04 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:25:04 user nova-compute[75113]:   </clock>
Oct 26 17:25:04 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:25:04 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:25:04 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:25:04 user nova-compute[75113]:   </cpu>
Oct 26 17:25:04 user nova-compute[75113]:   <devices>
Oct 26 17:25:04 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:25:04 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:25:04 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk"/>
Oct 26 17:25:04 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:25:04 user nova-compute[75113]:     </disk>
Oct 26 17:25:04 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:25:04 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:25:04 user nova-compute[75113]:       <source dev="/dev/sdc"/>
Oct 26 17:25:04 user nova-compute[75113]:       <target dev="vdc" bus="virtio"/>
Oct 26 17:25:04 user nova-compute[75113]:       <serial>9a4b6f77-b530-478d-aace-04b620a8107b</serial>
Oct 26 17:25:04 user nova-compute[75113]:     </disk>
Oct 26 17:25:04 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:25:04 user nova-compute[75113]:       <mac address="fa:16:3e:25:f2:8d"/>
Oct 26 17:25:04 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:25:04 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:25:04 user nova-compute[75113]:       <target dev="tapa579d831-4c"/>
Oct 26 17:25:04 user nova-compute[75113]:     </interface>
Oct 26 17:25:04 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:25:04 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/console.log" append="off"/>
Oct 26 17:25:04 user nova-compute[75113]:     </serial>
Oct 26 17:25:04 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:25:04 user nova-compute[75113]:     <video>
Oct 26 17:25:04 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:25:04 user nova-compute[75113]:     </video>
Oct 26 17:25:04 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:25:04 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:25:04 user nova-compute[75113]:     </rng>
Oct 26 17:25:04 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:25:04 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:25:04 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:25:04 user nova-compute[75113]:     </memballoon>
Oct 26 17:25:04 user nova-compute[75113]:   </devices>
Oct 26 17:25:04 user nova-compute[75113]: </domain>
Oct 26 17:25:04 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1601727451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1601727451',id=38,image_ref='0bb9e4df-d74b-4a38-91b7-43b9d1ecddaf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1190114021',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:20:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b425dca1e9645ad99fea4b666b01fab',ramdisk_id='',reservation_id='r-uwmu4xiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1688117037',owner_user_name='tempest-AttachVolumeShelveTestJSON-1688117037-project-member',shelved_at='2023-10-26T17:22:48.949196',shelved_host='user',shelved_image_id='0bb9e4df-d74b-4a38-91b7-43b9d1ecddaf'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:24:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b16af3affdf47f596f944cb83f772e9',uuid=f642e634-0efc-4ed2-aa00-ba2d3979b353,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converting VIF {"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG os_vif [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55bda5c1-4e4e-502e-9599-df34aea869fd', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa579d831-4c, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa579d831-4c, col_values=(('qos', UUID('8d852174-b8b8-4e33-a5f4-1f4f876e48da')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa579d831-4c, col_values=(('external_ids', {'iface-id': 'a579d831-4c13-4c14-bb83-d0eae63bfecc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:f2:8d', 'vm-uuid': 'f642e634-0efc-4ed2-aa00-ba2d3979b353'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:04 user nova-compute[75113]: INFO os_vif [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c')
Oct 26 17:25:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:25:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] No VIF found with MAC fa:16:3e:25:f2:8d, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:25:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-ca649532-52f2-475c-a428-d7b91624fdae req-80b15e48-7330-48e7-9673-a5e4c9eca344 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:25:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ca649532-52f2-475c-a428-d7b91624fdae req-80b15e48-7330-48e7-9673-a5e4c9eca344 service nova] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ca649532-52f2-475c-a428-d7b91624fdae req-80b15e48-7330-48e7-9673-a5e4c9eca344 service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ca649532-52f2-475c-a428-d7b91624fdae req-80b15e48-7330-48e7-9673-a5e4c9eca344 service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-ca649532-52f2-475c-a428-d7b91624fdae req-80b15e48-7330-48e7-9673-a5e4c9eca344 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] No waiting events found dispatching network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:25:06 user nova-compute[75113]: WARNING nova.compute.manager [req-ca649532-52f2-475c-a428-d7b91624fdae req-80b15e48-7330-48e7-9673-a5e4c9eca344 service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received unexpected event network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 17:25:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:08 user nova-compute[75113]: DEBUG nova.compute.manager [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:25:08 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:25:08 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Instance spawned successfully.
Oct 26 17:25:08 user nova-compute[75113]: DEBUG nova.compute.manager [req-bdc9c35c-89f5-4f1e-b046-50c3b4ce6a9c req-f4f6ba9b-60f9-4f34-9d1e-a7471656544c service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:25:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-bdc9c35c-89f5-4f1e-b046-50c3b4ce6a9c req-f4f6ba9b-60f9-4f34-9d1e-a7471656544c service nova] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-bdc9c35c-89f5-4f1e-b046-50c3b4ce6a9c req-f4f6ba9b-60f9-4f34-9d1e-a7471656544c service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-bdc9c35c-89f5-4f1e-b046-50c3b4ce6a9c req-f4f6ba9b-60f9-4f34-9d1e-a7471656544c service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:08 user nova-compute[75113]: DEBUG nova.compute.manager [req-bdc9c35c-89f5-4f1e-b046-50c3b4ce6a9c req-f4f6ba9b-60f9-4f34-9d1e-a7471656544c service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] No waiting events found dispatching network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:25:08 user nova-compute[75113]: WARNING nova.compute.manager [req-bdc9c35c-89f5-4f1e-b046-50c3b4ce6a9c req-f4f6ba9b-60f9-4f34-9d1e-a7471656544c service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received unexpected event network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 17:25:08 user nova-compute[75113]: DEBUG nova.compute.manager [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:25:08 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-558541c7-faa0-4403-9178-3828cc04e5c1 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 32.025s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG nova.compute.manager [req-96ad3d87-632c-49d7-92d8-ff6dc1655f17 req-8de9f97a-a9e3-462a-aec9-e624d43b1528 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Received event network-changed-9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG nova.compute.manager [req-96ad3d87-632c-49d7-92d8-ff6dc1655f17 req-8de9f97a-a9e3-462a-aec9-e624d43b1528 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Refreshing instance network info cache due to event network-changed-9c8d391d-ef18-4deb-9312-f9667d6362ea. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-96ad3d87-632c-49d7-92d8-ff6dc1655f17 req-8de9f97a-a9e3-462a-aec9-e624d43b1528 service nova] Acquiring lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-96ad3d87-632c-49d7-92d8-ff6dc1655f17 req-8de9f97a-a9e3-462a-aec9-e624d43b1528 service nova] Acquired lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG nova.network.neutron [req-96ad3d87-632c-49d7-92d8-ff6dc1655f17 req-8de9f97a-a9e3-462a-aec9-e624d43b1528 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Refreshing network info cache for port 9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:12 user nova-compute[75113]: INFO nova.compute.manager [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Terminating instance
Oct 26 17:25:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG nova.network.neutron [req-96ad3d87-632c-49d7-92d8-ff6dc1655f17 req-8de9f97a-a9e3-462a-aec9-e624d43b1528 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updated VIF entry in instance network info cache for port 9c8d391d-ef18-4deb-9312-f9667d6362ea. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG nova.network.neutron [req-96ad3d87-632c-49d7-92d8-ff6dc1655f17 req-8de9f97a-a9e3-462a-aec9-e624d43b1528 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updating instance_info_cache with network_info: [{"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:25:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-96ad3d87-632c-49d7-92d8-ff6dc1655f17 req-8de9f97a-a9e3-462a-aec9-e624d43b1528 service nova] Releasing lock "refresh_cache-fc80403d-8fbd-4836-8d01-89fa7aad8d7e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:25:12 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Instance destroyed successfully.
Oct 26 17:25:12 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lazy-loading 'resources' on Instance uuid fc80403d-8fbd-4836-8d01-89fa7aad8d7e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-863488592',display_name='tempest-TestStampPattern-server-863488592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-863488592',id=36,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWHyhdWG4vODww4J36tjcUt2ICXtezA7tiJccfBwgDPh+GMN+tQKBdFq+33nqzyfrbTLq8kX7WTafkfAiBXerZ2BCl1jBxwv1h0P5P+b6z5qmRWoytp+RGBDhwGCxEyfQ==',key_name='tempest-TestStampPattern-754663238',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:17:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95d413c67bd3476cbfeb8e39af59e9ee',ramdisk_id='',reservation_id='r-jx3aex1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1797568490',owner_user_name='tempest-TestStampPattern-1797568490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:20:48Z,user_data=None,user_id='cf60300c4d874a99a5a99bef82641993',uuid=fc80403d-8fbd-4836-8d01-89fa7aad8d7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Converting VIF {"id": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "address": "fa:16:3e:b4:37:33", "network": {"id": "4a27eecb-785b-4938-bb69-95b1d2d5aeba", "bridge": "br-int", "label": "tempest-TestStampPattern-482964220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95d413c67bd3476cbfeb8e39af59e9ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8d391d-ef", "ovs_interfaceid": "9c8d391d-ef18-4deb-9312-f9667d6362ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:37:33,bridge_name='br-int',has_traffic_filtering=True,id=9c8d391d-ef18-4deb-9312-f9667d6362ea,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8d391d-ef') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG os_vif [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:37:33,bridge_name='br-int',has_traffic_filtering=True,id=9c8d391d-ef18-4deb-9312-f9667d6362ea,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8d391d-ef') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c8d391d-ef, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d069062f-645c-416a-8926-cdc2b93d154f) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:13 user nova-compute[75113]: INFO os_vif [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:37:33,bridge_name='br-int',has_traffic_filtering=True,id=9c8d391d-ef18-4deb-9312-f9667d6362ea,network=Network(4a27eecb-785b-4938-bb69-95b1d2d5aeba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8d391d-ef')
Oct 26 17:25:13 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Deleting instance files /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e_del
Oct 26 17:25:13 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Deletion of /opt/stack/data/nova/instances/fc80403d-8fbd-4836-8d01-89fa7aad8d7e_del complete
Oct 26 17:25:13 user nova-compute[75113]: INFO nova.compute.manager [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 26 17:25:13 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:25:13 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Took 0.52 seconds to deallocate network for instance.
Oct 26 17:25:13 user nova-compute[75113]: DEBUG nova.compute.manager [req-9d70282d-7e40-48ba-a969-ce17d4a66400 req-10864378-6e18-48c3-a61b-ff4442bae34e service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Received event network-vif-deleted-9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:25:13 user nova-compute[75113]: INFO nova.compute.manager [req-9d70282d-7e40-48ba-a969-ce17d4a66400 req-10864378-6e18-48c3-a61b-ff4442bae34e service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Neutron deleted interface 9c8d391d-ef18-4deb-9312-f9667d6362ea; detaching it from the instance and deleting it from the info cache
Oct 26 17:25:13 user nova-compute[75113]: DEBUG nova.network.neutron [req-9d70282d-7e40-48ba-a969-ce17d4a66400 req-10864378-6e18-48c3-a61b-ff4442bae34e service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG nova.compute.manager [req-9d70282d-7e40-48ba-a969-ce17d4a66400 req-10864378-6e18-48c3-a61b-ff4442bae34e service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Detach interface failed, port_id=9c8d391d-ef18-4deb-9312-f9667d6362ea, reason: Instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:25:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:13 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Deleted allocations for instance fc80403d-8fbd-4836-8d01-89fa7aad8d7e
Oct 26 17:25:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4bf53d6a-a6fb-4ef8-bd1c-497d36030939 tempest-TestStampPattern-1797568490 tempest-TestStampPattern-1797568490-project-member] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.942s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-64fca6f0-3997-4642-bcae-82b6f2cb7667 req-b7909ce2-1c8f-4bff-aa4a-873c5921f2a1 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Received event network-vif-unplugged-9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:25:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-64fca6f0-3997-4642-bcae-82b6f2cb7667 req-b7909ce2-1c8f-4bff-aa4a-873c5921f2a1 service nova] Acquiring lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-64fca6f0-3997-4642-bcae-82b6f2cb7667 req-b7909ce2-1c8f-4bff-aa4a-873c5921f2a1 service nova] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-64fca6f0-3997-4642-bcae-82b6f2cb7667 req-b7909ce2-1c8f-4bff-aa4a-873c5921f2a1 service nova] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-64fca6f0-3997-4642-bcae-82b6f2cb7667 req-b7909ce2-1c8f-4bff-aa4a-873c5921f2a1 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] No waiting events found dispatching network-vif-unplugged-9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:25:14 user nova-compute[75113]: WARNING nova.compute.manager [req-64fca6f0-3997-4642-bcae-82b6f2cb7667 req-b7909ce2-1c8f-4bff-aa4a-873c5921f2a1 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Received unexpected event network-vif-unplugged-9c8d391d-ef18-4deb-9312-f9667d6362ea for instance with vm_state deleted and task_state None.
Oct 26 17:25:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-64fca6f0-3997-4642-bcae-82b6f2cb7667 req-b7909ce2-1c8f-4bff-aa4a-873c5921f2a1 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Received event network-vif-plugged-9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:25:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-64fca6f0-3997-4642-bcae-82b6f2cb7667 req-b7909ce2-1c8f-4bff-aa4a-873c5921f2a1 service nova] Acquiring lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-64fca6f0-3997-4642-bcae-82b6f2cb7667 req-b7909ce2-1c8f-4bff-aa4a-873c5921f2a1 service nova] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-64fca6f0-3997-4642-bcae-82b6f2cb7667 req-b7909ce2-1c8f-4bff-aa4a-873c5921f2a1 service nova] Lock "fc80403d-8fbd-4836-8d01-89fa7aad8d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-64fca6f0-3997-4642-bcae-82b6f2cb7667 req-b7909ce2-1c8f-4bff-aa4a-873c5921f2a1 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] No waiting events found dispatching network-vif-plugged-9c8d391d-ef18-4deb-9312-f9667d6362ea {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:25:14 user nova-compute[75113]: WARNING nova.compute.manager [req-64fca6f0-3997-4642-bcae-82b6f2cb7667 req-b7909ce2-1c8f-4bff-aa4a-873c5921f2a1 service nova] [instance: fc80403d-8fbd-4836-8d01-89fa7aad8d7e] Received unexpected event network-vif-plugged-9c8d391d-ef18-4deb-9312-f9667d6362ea for instance with vm_state deleted and task_state None.
Oct 26 17:25:17 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:25:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:20 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:25:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:25:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:25:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:25:24 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:25:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:25:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:25 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:25:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:25:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:25:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:26 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:25:26 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:25:26 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8620MB free_disk=25.119667053222656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:25:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:26 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 3bde34c7-f234-4c16-b631-224c029ba6e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:25:26 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance f642e634-0efc-4ed2-aa00-ba2d3979b353 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:25:26 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:25:26 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:25:26 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:25:26 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:25:26 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:25:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:27 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:25:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:25:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:25:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:25:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:25:27 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:25:27 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 3bde34c7-f234-4c16-b631-224c029ba6e8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:25:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:28 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating instance_info_cache with network_info: [{"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:25:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:25:28 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:25:28 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:25:28 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:25:28 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:25:29 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:25:29 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 17:25:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:25:36 user nova-compute[75113]: INFO nova.compute.claims [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Claim successful on node user
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Refreshing inventories for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Updating ProviderTree inventory for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Updating inventory in ProviderTree for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Refreshing aggregate associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, aggregates: None {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Refreshing trait associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:25:36 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.policy [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47bb03390d7d489d91750653f399125f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30bd0e84d1448158ca783491ed372f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:25:36 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Creating image(s)
Oct 26 17:25:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "/opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "/opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk 1073741824" returned: 0 in 0.053s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.192s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Successfully created port: 2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Cannot resize image /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Ensure instance console log exists: /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Successfully updated port: 2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquired lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-c9bf7740-1e82-4a10-a18b-b66ff87cb9c1 req-a83fb5e6-ee69-4ff3-956e-64973f286a53 service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Received event network-changed-2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-c9bf7740-1e82-4a10-a18b-b66ff87cb9c1 req-a83fb5e6-ee69-4ff3-956e-64973f286a53 service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Refreshing instance network info cache due to event network-changed-2e7c529d-8456-49e4-be69-66b8b4f86d00. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c9bf7740-1e82-4a10-a18b-b66ff87cb9c1 req-a83fb5e6-ee69-4ff3-956e-64973f286a53 service nova] Acquiring lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Updating instance_info_cache with network_info: [{"id": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "address": "fa:16:3e:dd:45:07", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c529d-84", "ovs_interfaceid": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Releasing lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Instance network_info: |[{"id": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "address": "fa:16:3e:dd:45:07", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c529d-84", "ovs_interfaceid": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c9bf7740-1e82-4a10-a18b-b66ff87cb9c1 req-a83fb5e6-ee69-4ff3-956e-64973f286a53 service nova] Acquired lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.network.neutron [req-c9bf7740-1e82-4a10-a18b-b66ff87cb9c1 req-a83fb5e6-ee69-4ff3-956e-64973f286a53 service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Refreshing network info cache for port 2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Start _get_guest_xml network_info=[{"id": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "address": "fa:16:3e:dd:45:07", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c529d-84", "ovs_interfaceid": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:25:38 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:25:38 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:25:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1485832923',display_name='tempest-AttachVolumeNegativeTest-server-1485832923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1485832923',id=41,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZdROu/DGyoXThU0i9TihXUoo0/D7NZfVSjRaFI3teE5AkGS4C42odDd7Nv9lFubaghYH2GJKkuHAgYRI93wIwLMy8X4swARqq6t9f+nMtU+kRk+o7dcb7MK6sJ2SDA+g==',key_name='tempest-keypair-1633032287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30bd0e84d1448158ca783491ed372f5',ramdisk_id='',reservation_id='r-8w6cdl1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1111816565',owner_user_name='tempest-AttachVolumeNegativeTest-1111816565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:25:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47bb03390d7d489d91750653f399125f',uuid=2bfe78d7-34e4-4cdb-bbb2-3ae460a16610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "address": "fa:16:3e:dd:45:07", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c529d-84", "ovs_interfaceid": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converting VIF {"id": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "address": "fa:16:3e:dd:45:07", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c529d-84", "ovs_interfaceid": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:45:07,bridge_name='br-int',has_traffic_filtering=True,id=2e7c529d-8456-49e4-be69-66b8b4f86d00,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c529d-84') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:25:38 user nova-compute[75113]:   <uuid>2bfe78d7-34e4-4cdb-bbb2-3ae460a16610</uuid>
Oct 26 17:25:38 user nova-compute[75113]:   <name>instance-00000029</name>
Oct 26 17:25:38 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:25:38 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:25:38 user nova-compute[75113]:   <metadata>
Oct 26 17:25:38 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:25:38 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:25:38 user nova-compute[75113]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1485832923</nova:name>
Oct 26 17:25:38 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:25:38</nova:creationTime>
Oct 26 17:25:38 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:25:38 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:25:38 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:25:38 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:25:38 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:25:38 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:25:38 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:25:38 user nova-compute[75113]:       <nova:owner>
Oct 26 17:25:38 user nova-compute[75113]:         <nova:user uuid="47bb03390d7d489d91750653f399125f">tempest-AttachVolumeNegativeTest-1111816565-project-member</nova:user>
Oct 26 17:25:38 user nova-compute[75113]:         <nova:project uuid="c30bd0e84d1448158ca783491ed372f5">tempest-AttachVolumeNegativeTest-1111816565</nova:project>
Oct 26 17:25:38 user nova-compute[75113]:       </nova:owner>
Oct 26 17:25:38 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:25:38 user nova-compute[75113]:       <nova:ports>
Oct 26 17:25:38 user nova-compute[75113]:         <nova:port uuid="2e7c529d-8456-49e4-be69-66b8b4f86d00">
Oct 26 17:25:38 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 17:25:38 user nova-compute[75113]:         </nova:port>
Oct 26 17:25:38 user nova-compute[75113]:       </nova:ports>
Oct 26 17:25:38 user nova-compute[75113]:     </nova:instance>
Oct 26 17:25:38 user nova-compute[75113]:   </metadata>
Oct 26 17:25:38 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:25:38 user nova-compute[75113]:     <system>
Oct 26 17:25:38 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:25:38 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:25:38 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:25:38 user nova-compute[75113]:       <entry name="serial">2bfe78d7-34e4-4cdb-bbb2-3ae460a16610</entry>
Oct 26 17:25:38 user nova-compute[75113]:       <entry name="uuid">2bfe78d7-34e4-4cdb-bbb2-3ae460a16610</entry>
Oct 26 17:25:38 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:25:38 user nova-compute[75113]:     </system>
Oct 26 17:25:38 user nova-compute[75113]:   </sysinfo>
Oct 26 17:25:38 user nova-compute[75113]:   <os>
Oct 26 17:25:38 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:25:38 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:25:38 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:25:38 user nova-compute[75113]:   </os>
Oct 26 17:25:38 user nova-compute[75113]:   <features>
Oct 26 17:25:38 user nova-compute[75113]:     <acpi/>
Oct 26 17:25:38 user nova-compute[75113]:     <apic/>
Oct 26 17:25:38 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:25:38 user nova-compute[75113]:   </features>
Oct 26 17:25:38 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:25:38 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:25:38 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:25:38 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:25:38 user nova-compute[75113]:   </clock>
Oct 26 17:25:38 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:25:38 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:25:38 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:25:38 user nova-compute[75113]:   </cpu>
Oct 26 17:25:38 user nova-compute[75113]:   <devices>
Oct 26 17:25:38 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:25:38 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:25:38 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk"/>
Oct 26 17:25:38 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:25:38 user nova-compute[75113]:     </disk>
Oct 26 17:25:38 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:25:38 user nova-compute[75113]:       <mac address="fa:16:3e:dd:45:07"/>
Oct 26 17:25:38 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:25:38 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:25:38 user nova-compute[75113]:       <target dev="tap2e7c529d-84"/>
Oct 26 17:25:38 user nova-compute[75113]:     </interface>
Oct 26 17:25:38 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:25:38 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/console.log" append="off"/>
Oct 26 17:25:38 user nova-compute[75113]:     </serial>
Oct 26 17:25:38 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:25:38 user nova-compute[75113]:     <video>
Oct 26 17:25:38 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:25:38 user nova-compute[75113]:     </video>
Oct 26 17:25:38 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:25:38 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:25:38 user nova-compute[75113]:     </rng>
Oct 26 17:25:38 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:25:38 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:25:38 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:25:38 user nova-compute[75113]:     </memballoon>
Oct 26 17:25:38 user nova-compute[75113]:   </devices>
Oct 26 17:25:38 user nova-compute[75113]: </domain>
Oct 26 17:25:38 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:25:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1485832923',display_name='tempest-AttachVolumeNegativeTest-server-1485832923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1485832923',id=41,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZdROu/DGyoXThU0i9TihXUoo0/D7NZfVSjRaFI3teE5AkGS4C42odDd7Nv9lFubaghYH2GJKkuHAgYRI93wIwLMy8X4swARqq6t9f+nMtU+kRk+o7dcb7MK6sJ2SDA+g==',key_name='tempest-keypair-1633032287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30bd0e84d1448158ca783491ed372f5',ramdisk_id='',reservation_id='r-8w6cdl1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1111816565',owner_user_name='tempest-AttachVolumeNegativeTest-1111816565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:25:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47bb03390d7d489d91750653f399125f',uuid=2bfe78d7-34e4-4cdb-bbb2-3ae460a16610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "address": "fa:16:3e:dd:45:07", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c529d-84", "ovs_interfaceid": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converting VIF {"id": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "address": "fa:16:3e:dd:45:07", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c529d-84", "ovs_interfaceid": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:45:07,bridge_name='br-int',has_traffic_filtering=True,id=2e7c529d-8456-49e4-be69-66b8b4f86d00,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c529d-84') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG os_vif [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:45:07,bridge_name='br-int',has_traffic_filtering=True,id=2e7c529d-8456-49e4-be69-66b8b4f86d00,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c529d-84') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a3509eb-74fa-5eee-9571-3d8add9c0cd4', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e7c529d-84, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e7c529d-84, col_values=(('qos', UUID('0db1be39-7555-4f82-869a-d128b48ca165')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e7c529d-84, col_values=(('external_ids', {'iface-id': '2e7c529d-8456-49e4-be69-66b8b4f86d00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:45:07', 'vm-uuid': '2bfe78d7-34e4-4cdb-bbb2-3ae460a16610'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:38 user nova-compute[75113]: INFO os_vif [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:45:07,bridge_name='br-int',has_traffic_filtering=True,id=2e7c529d-8456-49e4-be69-66b8b4f86d00,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c529d-84')
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:25:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No VIF found with MAC fa:16:3e:dd:45:07, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG nova.network.neutron [req-c9bf7740-1e82-4a10-a18b-b66ff87cb9c1 req-a83fb5e6-ee69-4ff3-956e-64973f286a53 service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Updated VIF entry in instance network info cache for port 2e7c529d-8456-49e4-be69-66b8b4f86d00. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG nova.network.neutron [req-c9bf7740-1e82-4a10-a18b-b66ff87cb9c1 req-a83fb5e6-ee69-4ff3-956e-64973f286a53 service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Updating instance_info_cache with network_info: [{"id": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "address": "fa:16:3e:dd:45:07", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c529d-84", "ovs_interfaceid": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-7836606f-05ad-46b3-96a8-8f9d4728e6d4 req-4677d86a-8422-4b10-a187-521daf71966f service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-changed-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-7836606f-05ad-46b3-96a8-8f9d4728e6d4 req-4677d86a-8422-4b10-a187-521daf71966f service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Refreshing instance network info cache due to event network-changed-6af72c21-9dc2-4a66-b0fe-792b2ff617fe. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7836606f-05ad-46b3-96a8-8f9d4728e6d4 req-4677d86a-8422-4b10-a187-521daf71966f service nova] Acquiring lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7836606f-05ad-46b3-96a8-8f9d4728e6d4 req-4677d86a-8422-4b10-a187-521daf71966f service nova] Acquired lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG nova.network.neutron [req-7836606f-05ad-46b3-96a8-8f9d4728e6d4 req-4677d86a-8422-4b10-a187-521daf71966f service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Refreshing network info cache for port 6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c9bf7740-1e82-4a10-a18b-b66ff87cb9c1 req-a83fb5e6-ee69-4ff3-956e-64973f286a53 service nova] Releasing lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG nova.network.neutron [req-7836606f-05ad-46b3-96a8-8f9d4728e6d4 req-4677d86a-8422-4b10-a187-521daf71966f service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updated VIF entry in instance network info cache for port 6af72c21-9dc2-4a66-b0fe-792b2ff617fe. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG nova.network.neutron [req-7836606f-05ad-46b3-96a8-8f9d4728e6d4 req-4677d86a-8422-4b10-a187-521daf71966f service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating instance_info_cache with network_info: [{"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7836606f-05ad-46b3-96a8-8f9d4728e6d4 req-4677d86a-8422-4b10-a187-521daf71966f service nova] Releasing lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "3bde34c7-f234-4c16-b631-224c029ba6e8" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:39 user nova-compute[75113]: INFO nova.compute.manager [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Shelve offloading
Oct 26 17:25:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-4cb56ec5-26df-484c-b59b-feca8e4753ca req-3b1b6e98-acd8-4473-a7a1-e71e4f6630a3 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-vif-unplugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4cb56ec5-26df-484c-b59b-feca8e4753ca req-3b1b6e98-acd8-4473-a7a1-e71e4f6630a3 service nova] Acquiring lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4cb56ec5-26df-484c-b59b-feca8e4753ca req-3b1b6e98-acd8-4473-a7a1-e71e4f6630a3 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4cb56ec5-26df-484c-b59b-feca8e4753ca req-3b1b6e98-acd8-4473-a7a1-e71e4f6630a3 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-4cb56ec5-26df-484c-b59b-feca8e4753ca req-3b1b6e98-acd8-4473-a7a1-e71e4f6630a3 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] No waiting events found dispatching network-vif-unplugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:25:39 user nova-compute[75113]: WARNING nova.compute.manager [req-4cb56ec5-26df-484c-b59b-feca8e4753ca req-3b1b6e98-acd8-4473-a7a1-e71e4f6630a3 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received unexpected event network-vif-unplugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe for instance with vm_state active and task_state shelving.
Oct 26 17:25:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:40 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:25:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:40 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Instance destroyed successfully.
Oct 26 17:25:40 user nova-compute[75113]: DEBUG nova.compute.manager [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:25:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:25:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquired lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:25:40 user nova-compute[75113]: DEBUG nova.network.neutron [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:25:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.network.neutron [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating instance_info_cache with network_info: [{"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Releasing lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:25:41 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Instance destroyed successfully.
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.objects.instance [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lazy-loading 'resources' on Instance uuid 3bde34c7-f234-4c16-b631-224c029ba6e8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:23:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1599500593',display_name='tempest-TestShelveInstance-server-1599500593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1599500593',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWVYz4AZfs9UYgwkwxK7OMuSZTVhnIn/EUPYm9pX6bRnq6gwN6QncrGykfiZNHRCcFcYVdnOMJQERLBZ6bzbFz5klneMgbu61zTsYgzkwt+J+lV920+/sRSLOz+P5SYPg==',key_name='tempest-TestShelveInstance-1332116264',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:24:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='309b039fa49c4e399504dcdcff86724e',ramdisk_id='',reservation_id='r-t2nawjxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1069964257',owner_user_name='tempest-TestShelveInstance-1069964257-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:24:12Z,user_data=None,user_id='d5efe78e0cd34414853f640e4c850e5d',uuid=3bde34c7-f234-4c16-b631-224c029ba6e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Converting VIF {"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_vif [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6af72c21-9d, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe1c7a11-f814-4c61-8c50-e3107d4d76b7) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-0f374005-7330-4e78-91c6-8905de2ea881 req-58f5b485-2ca9-4d70-b074-a6e0fde4ab10 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-changed-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-0f374005-7330-4e78-91c6-8905de2ea881 req-58f5b485-2ca9-4d70-b074-a6e0fde4ab10 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Refreshing instance network info cache due to event network-changed-6af72c21-9dc2-4a66-b0fe-792b2ff617fe. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0f374005-7330-4e78-91c6-8905de2ea881 req-58f5b485-2ca9-4d70-b074-a6e0fde4ab10 service nova] Acquiring lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0f374005-7330-4e78-91c6-8905de2ea881 req-58f5b485-2ca9-4d70-b074-a6e0fde4ab10 service nova] Acquired lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.network.neutron [req-0f374005-7330-4e78-91c6-8905de2ea881 req-58f5b485-2ca9-4d70-b074-a6e0fde4ab10 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Refreshing network info cache for port 6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:41 user nova-compute[75113]: INFO os_vif [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d')
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXDzWLga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:25:41 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5ffa9f-a673-4df8-b783-3f142fd693bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:25:41 user nova-compute[75113]: No targets found.
Oct 26 17:25:41 user nova-compute[75113]: iSNS:
Oct 26 17:25:41 user nova-compute[75113]: No targets found.
Oct 26 17:25:41 user nova-compute[75113]: STATIC:
Oct 26 17:25:41 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b
Oct 26 17:25:41 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:25:41 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:25:41 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad
Oct 26 17:25:41 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:25:41 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:25:41 user nova-compute[75113]: FIRMWARE:
Oct 26 17:25:41 user nova-compute[75113]: No targets found.
Oct 26 17:25:41 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:25:41 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:25:41 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79362de-9fbf-4804-a00b-29e83c31df66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd8aaff-2621-4beb-b984-b2ff948d8510]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:25:41 user nova-compute[75113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b (non-flash)
Oct 26 17:25:41 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:25:41 user nova-compute[75113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b (non-flash)
Oct 26 17:25:41 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f48f4776d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a3e9e1-af70-483b-9756-f56f2b81e3bb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd0d205-51b7-43c6-a053-917a50f97594]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[989e4d2f-6939-40b7-a535-71d416446a52]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe46bf6-6a2c-49ef-bc4b-fdccbaa08719]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[513845b3-dedc-470e-8801-f6109939b9d1]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] Acquiring lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] No waiting events found dispatching network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:25:41 user nova-compute[75113]: WARNING nova.compute.manager [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received unexpected event network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe for instance with vm_state active and task_state shelving.
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Received event network-vif-plugged-2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] Acquiring lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] No waiting events found dispatching network-vif-plugged-2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:25:41 user nova-compute[75113]: WARNING nova.compute.manager [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Received unexpected event network-vif-plugged-2e7c529d-8456-49e4-be69-66b8b4f86d00 for instance with vm_state building and task_state spawning.
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Received event network-vif-plugged-2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] Acquiring lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] No waiting events found dispatching network-vif-plugged-2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:25:41 user nova-compute[75113]: WARNING nova.compute.manager [req-266dfd55-6bc1-4f6e-9333-d1a237e75d01 req-3c2788b8-c7f5-4e1f-8f53-fed3f44410dd service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Received unexpected event network-vif-plugged-2e7c529d-8456-49e4-be69-66b8b4f86d00 for instance with vm_state building and task_state spawning.
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f26ac48-7f5b-4317-9bb4-363fed032e2a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260]
Oct 26 17:25:41 user nova-compute[75113]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260] successful.
Oct 26 17:25:41 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:25:41 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc72ec1d-f3fc-4919-b52e-b154f5a1af01]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] <== disconnect_volume: return (290ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:25:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Deleting instance files /opt/stack/data/nova/instances/3bde34c7-f234-4c16-b631-224c029ba6e8_del
Oct 26 17:25:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Deletion of /opt/stack/data/nova/instances/3bde34c7-f234-4c16-b631-224c029ba6e8_del complete
Oct 26 17:25:42 user nova-compute[75113]: DEBUG nova.network.neutron [req-0f374005-7330-4e78-91c6-8905de2ea881 req-58f5b485-2ca9-4d70-b074-a6e0fde4ab10 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updated VIF entry in instance network info cache for port 6af72c21-9dc2-4a66-b0fe-792b2ff617fe. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG nova.network.neutron [req-0f374005-7330-4e78-91c6-8905de2ea881 req-58f5b485-2ca9-4d70-b074-a6e0fde4ab10 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating instance_info_cache with network_info: [{"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": null, "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6af72c21-9d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0f374005-7330-4e78-91c6-8905de2ea881 req-58f5b485-2ca9-4d70-b074-a6e0fde4ab10 service nova] Releasing lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:25:42 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Instance spawned successfully.
Oct 26 17:25:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:25:42 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:25:42 user nova-compute[75113]: INFO nova.compute.manager [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Took 5.74 seconds to spawn the instance on the hypervisor.
Oct 26 17:25:42 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:25:42 user nova-compute[75113]: INFO nova.compute.manager [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Took 6.40 seconds to build instance.
Oct 26 17:25:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4c49df10-3d66-4ab5-890e-53d4d7e9df21 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.494s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:43 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Deleted allocations for instance 3bde34c7-f234-4c16-b631-224c029ba6e8
Oct 26 17:25:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:25:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:25:43 user nova-compute[75113]: DEBUG nova.objects.instance [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lazy-loading 'numa_topology' on Instance uuid 3bde34c7-f234-4c16-b631-224c029ba6e8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:25:43 user nova-compute[75113]: DEBUG nova.objects.base [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Object Instance<3bde34c7-f234-4c16-b631-224c029ba6e8> lazy-loaded attributes: resources,numa_topology {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:25:43 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:25:43 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:25:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-0d27de5c-f715-4595-97fa-341fa79b225d tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.901s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:25:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:47 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:25:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 17:25:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] There are 0 instances to clean {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 17:25:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:25:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:17 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:26:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:22 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:26:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:26:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:26 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:26:26 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:26:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:26:27 user nova-compute[75113]: INFO nova.compute.manager [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Detaching volume 9a4b6f77-b530-478d-aace-04b620a8107b
Oct 26 17:26:27 user nova-compute[75113]: INFO nova.virt.block_device [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Attempting to driver detach volume 9a4b6f77-b530-478d-aace-04b620a8107b from mountpoint /dev/vdc
Oct 26 17:26:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Attempting to detach device vdc from instance f642e634-0efc-4ed2-aa00-ba2d3979b353 from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:26:27 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:26:27 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:26:27 user nova-compute[75113]:   <target dev="vdc" bus="virtio"/>
Oct 26 17:26:27 user nova-compute[75113]:   <serial>9a4b6f77-b530-478d-aace-04b620a8107b</serial>
Oct 26 17:26:27 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 17:26:27 user nova-compute[75113]: </disk>
Oct 26 17:26:27 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:26:27 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Successfully detached device vdc from instance f642e634-0efc-4ed2-aa00-ba2d3979b353 from the persistent domain config.
Oct 26 17:26:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f642e634-0efc-4ed2-aa00-ba2d3979b353 from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:26:27 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:26:27 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:26:27 user nova-compute[75113]:   <target dev="vdc" bus="virtio"/>
Oct 26 17:26:27 user nova-compute[75113]:   <serial>9a4b6f77-b530-478d-aace-04b620a8107b</serial>
Oct 26 17:26:27 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 17:26:27 user nova-compute[75113]: </disk>
Oct 26 17:26:27 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f642e634-0efc-4ed2-aa00-ba2d3979b353 {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:26:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:28 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:26:28 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:26:28 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8623MB free_disk=25.078826904296875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:26:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:26:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:26:28 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance f642e634-0efc-4ed2-aa00-ba2d3979b353 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:26:28 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:26:28 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:26:28 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:26:28 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:26:28 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:26:28 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:26:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:26:30 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:26:30 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:26:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:26:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:26:30 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:26:31 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updating instance_info_cache with network_info: [{"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:26:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-f642e634-0efc-4ed2-aa00-ba2d3979b353" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:26:31 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:26:31 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:26:31 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:26:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:26:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:26:32 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:26:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:26:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:26:32 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:26:32 user nova-compute[75113]: INFO nova.compute.claims [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Claim successful on node user
Oct 26 17:26:33 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:26:33 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:26:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG nova.policy [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c328bc794cde4ee1b1f2b210503317af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fd3b9d04974136a73ca94037077ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:26:33 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Creating image(s)
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "/opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "/opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "/opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.171s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk 1073741824" returned: 0 in 0.054s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:26:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Successfully created port: 2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Cannot resize image /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Ensure instance console log exists: /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Successfully updated port: 2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquired lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-e356b2d4-5030-4e05-8c42-5e33800282e5 req-06f71451-9676-4bc2-8aeb-b7b677a44ab3 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Received event network-changed-2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG nova.compute.manager [req-e356b2d4-5030-4e05-8c42-5e33800282e5 req-06f71451-9676-4bc2-8aeb-b7b677a44ab3 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Refreshing instance network info cache due to event network-changed-2cb265c0-d6bd-45df-8f3f-644e528b3649. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e356b2d4-5030-4e05-8c42-5e33800282e5 req-06f71451-9676-4bc2-8aeb-b7b677a44ab3 service nova] Acquiring lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:26:34 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.network.neutron [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updating instance_info_cache with network_info: [{"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Releasing lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Instance network_info: |[{"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e356b2d4-5030-4e05-8c42-5e33800282e5 req-06f71451-9676-4bc2-8aeb-b7b677a44ab3 service nova] Acquired lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.network.neutron [req-e356b2d4-5030-4e05-8c42-5e33800282e5 req-06f71451-9676-4bc2-8aeb-b7b677a44ab3 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Refreshing network info cache for port 2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Start _get_guest_xml network_info=[{"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:26:35 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:26:35 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1518380257',display_name='tempest-SnapshotDataIntegrityTests-server-1518380257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1518380257',id=42,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM72a5iswLF9qRkPAQTKu+MlJ8Lo+VmfOB/9nwYs170yTm6gViovtBCEp4YEzt5mkqZbS1/6RItme//svyMYKKg2oj153HpIWwDEs7xEJmJL6I4UUvhXEC2WcNE6/mqpw==',key_name='tempest-keypair-923807152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94fd3b9d04974136a73ca94037077ee0',ramdisk_id='',reservation_id='r-95dpv00i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1837637180',owner_user_name='tempest-SnapshotDataIntegrityTests-1837637180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:26:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c328bc794cde4ee1b1f2b210503317af',uuid=97199d01-06b9-4e73-a23e-2b6110544afe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Converting VIF {"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:36,bridge_name='br-int',has_traffic_filtering=True,id=2cb265c0-d6bd-45df-8f3f-644e528b3649,network=Network(481d2d50-98a1-4c31-adbe-e282f5b40f73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb265c0-d6') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.objects.instance [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'pci_devices' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:26:35 user nova-compute[75113]:   <uuid>97199d01-06b9-4e73-a23e-2b6110544afe</uuid>
Oct 26 17:26:35 user nova-compute[75113]:   <name>instance-0000002a</name>
Oct 26 17:26:35 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:26:35 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:26:35 user nova-compute[75113]:   <metadata>
Oct 26 17:26:35 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:26:35 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:26:35 user nova-compute[75113]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1518380257</nova:name>
Oct 26 17:26:35 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:26:35</nova:creationTime>
Oct 26 17:26:35 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:26:35 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:26:35 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:26:35 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:26:35 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:26:35 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:26:35 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:26:35 user nova-compute[75113]:       <nova:owner>
Oct 26 17:26:35 user nova-compute[75113]:         <nova:user uuid="c328bc794cde4ee1b1f2b210503317af">tempest-SnapshotDataIntegrityTests-1837637180-project-member</nova:user>
Oct 26 17:26:35 user nova-compute[75113]:         <nova:project uuid="94fd3b9d04974136a73ca94037077ee0">tempest-SnapshotDataIntegrityTests-1837637180</nova:project>
Oct 26 17:26:35 user nova-compute[75113]:       </nova:owner>
Oct 26 17:26:35 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:26:35 user nova-compute[75113]:       <nova:ports>
Oct 26 17:26:35 user nova-compute[75113]:         <nova:port uuid="2cb265c0-d6bd-45df-8f3f-644e528b3649">
Oct 26 17:26:35 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 17:26:35 user nova-compute[75113]:         </nova:port>
Oct 26 17:26:35 user nova-compute[75113]:       </nova:ports>
Oct 26 17:26:35 user nova-compute[75113]:     </nova:instance>
Oct 26 17:26:35 user nova-compute[75113]:   </metadata>
Oct 26 17:26:35 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:26:35 user nova-compute[75113]:     <system>
Oct 26 17:26:35 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:26:35 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:26:35 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:26:35 user nova-compute[75113]:       <entry name="serial">97199d01-06b9-4e73-a23e-2b6110544afe</entry>
Oct 26 17:26:35 user nova-compute[75113]:       <entry name="uuid">97199d01-06b9-4e73-a23e-2b6110544afe</entry>
Oct 26 17:26:35 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:26:35 user nova-compute[75113]:     </system>
Oct 26 17:26:35 user nova-compute[75113]:   </sysinfo>
Oct 26 17:26:35 user nova-compute[75113]:   <os>
Oct 26 17:26:35 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:26:35 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:26:35 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:26:35 user nova-compute[75113]:   </os>
Oct 26 17:26:35 user nova-compute[75113]:   <features>
Oct 26 17:26:35 user nova-compute[75113]:     <acpi/>
Oct 26 17:26:35 user nova-compute[75113]:     <apic/>
Oct 26 17:26:35 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:26:35 user nova-compute[75113]:   </features>
Oct 26 17:26:35 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:26:35 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:26:35 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:26:35 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:26:35 user nova-compute[75113]:   </clock>
Oct 26 17:26:35 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:26:35 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:26:35 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:26:35 user nova-compute[75113]:   </cpu>
Oct 26 17:26:35 user nova-compute[75113]:   <devices>
Oct 26 17:26:35 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:26:35 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:26:35 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk"/>
Oct 26 17:26:35 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:26:35 user nova-compute[75113]:     </disk>
Oct 26 17:26:35 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:26:35 user nova-compute[75113]:       <mac address="fa:16:3e:5f:9f:36"/>
Oct 26 17:26:35 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:26:35 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:26:35 user nova-compute[75113]:       <target dev="tap2cb265c0-d6"/>
Oct 26 17:26:35 user nova-compute[75113]:     </interface>
Oct 26 17:26:35 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:26:35 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/console.log" append="off"/>
Oct 26 17:26:35 user nova-compute[75113]:     </serial>
Oct 26 17:26:35 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:26:35 user nova-compute[75113]:     <video>
Oct 26 17:26:35 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:26:35 user nova-compute[75113]:     </video>
Oct 26 17:26:35 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:26:35 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:26:35 user nova-compute[75113]:     </rng>
Oct 26 17:26:35 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:26:35 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:26:35 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:26:35 user nova-compute[75113]:     </memballoon>
Oct 26 17:26:35 user nova-compute[75113]:   </devices>
Oct 26 17:26:35 user nova-compute[75113]: </domain>
Oct 26 17:26:35 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1518380257',display_name='tempest-SnapshotDataIntegrityTests-server-1518380257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1518380257',id=42,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM72a5iswLF9qRkPAQTKu+MlJ8Lo+VmfOB/9nwYs170yTm6gViovtBCEp4YEzt5mkqZbS1/6RItme//svyMYKKg2oj153HpIWwDEs7xEJmJL6I4UUvhXEC2WcNE6/mqpw==',key_name='tempest-keypair-923807152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94fd3b9d04974136a73ca94037077ee0',ramdisk_id='',reservation_id='r-95dpv00i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1837637180',owner_user_name='tempest-SnapshotDataIntegrityTests-1837637180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:26:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c328bc794cde4ee1b1f2b210503317af',uuid=97199d01-06b9-4e73-a23e-2b6110544afe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Converting VIF {"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:36,bridge_name='br-int',has_traffic_filtering=True,id=2cb265c0-d6bd-45df-8f3f-644e528b3649,network=Network(481d2d50-98a1-4c31-adbe-e282f5b40f73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb265c0-d6') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG os_vif [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:36,bridge_name='br-int',has_traffic_filtering=True,id=2cb265c0-d6bd-45df-8f3f-644e528b3649,network=Network(481d2d50-98a1-4c31-adbe-e282f5b40f73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb265c0-d6') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c60a6b10-2f5c-549d-a367-11a4464f0121', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cb265c0-d6, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cb265c0-d6, col_values=(('qos', UUID('47c7a321-5435-4236-ba3e-9fd33b1f2622')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cb265c0-d6, col_values=(('external_ids', {'iface-id': '2cb265c0-d6bd-45df-8f3f-644e528b3649', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:9f:36', 'vm-uuid': '97199d01-06b9-4e73-a23e-2b6110544afe'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:35 user nova-compute[75113]: INFO os_vif [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:36,bridge_name='br-int',has_traffic_filtering=True,id=2cb265c0-d6bd-45df-8f3f-644e528b3649,network=Network(481d2d50-98a1-4c31-adbe-e282f5b40f73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb265c0-d6')
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No VIF found with MAC fa:16:3e:5f:9f:36, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.network.neutron [req-e356b2d4-5030-4e05-8c42-5e33800282e5 req-06f71451-9676-4bc2-8aeb-b7b677a44ab3 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updated VIF entry in instance network info cache for port 2cb265c0-d6bd-45df-8f3f-644e528b3649. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG nova.network.neutron [req-e356b2d4-5030-4e05-8c42-5e33800282e5 req-06f71451-9676-4bc2-8aeb-b7b677a44ab3 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updating instance_info_cache with network_info: [{"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:26:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e356b2d4-5030-4e05-8c42-5e33800282e5 req-06f71451-9676-4bc2-8aeb-b7b677a44ab3 service nova] Releasing lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:26:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-eeadd940-80fc-481c-ba51-a692465a7405 req-c570d652-26c4-4ee7-a325-22521d531cd6 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Received event network-vif-plugged-2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:26:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-eeadd940-80fc-481c-ba51-a692465a7405 req-c570d652-26c4-4ee7-a325-22521d531cd6 service nova] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:26:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-eeadd940-80fc-481c-ba51-a692465a7405 req-c570d652-26c4-4ee7-a325-22521d531cd6 service nova] Lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:26:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-eeadd940-80fc-481c-ba51-a692465a7405 req-c570d652-26c4-4ee7-a325-22521d531cd6 service nova] Lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:26:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-eeadd940-80fc-481c-ba51-a692465a7405 req-c570d652-26c4-4ee7-a325-22521d531cd6 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] No waiting events found dispatching network-vif-plugged-2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:26:36 user nova-compute[75113]: WARNING nova.compute.manager [req-eeadd940-80fc-481c-ba51-a692465a7405 req-c570d652-26c4-4ee7-a325-22521d531cd6 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Received unexpected event network-vif-plugged-2cb265c0-d6bd-45df-8f3f-644e528b3649 for instance with vm_state building and task_state spawning.
Oct 26 17:26:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:38 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:26:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:26:38 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Instance spawned successfully.
Oct 26 17:26:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:26:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:26:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:26:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:26:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:26:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:26:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:26:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-55698354-aa76-40f6-ba8a-8a6328e0df6d req-851e1d44-db63-4867-bacb-bd7aebd3a0af service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Received event network-vif-plugged-2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:26:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55698354-aa76-40f6-ba8a-8a6328e0df6d req-851e1d44-db63-4867-bacb-bd7aebd3a0af service nova] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:26:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55698354-aa76-40f6-ba8a-8a6328e0df6d req-851e1d44-db63-4867-bacb-bd7aebd3a0af service nova] Lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:26:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-55698354-aa76-40f6-ba8a-8a6328e0df6d req-851e1d44-db63-4867-bacb-bd7aebd3a0af service nova] Lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:26:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-55698354-aa76-40f6-ba8a-8a6328e0df6d req-851e1d44-db63-4867-bacb-bd7aebd3a0af service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] No waiting events found dispatching network-vif-plugged-2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:26:38 user nova-compute[75113]: WARNING nova.compute.manager [req-55698354-aa76-40f6-ba8a-8a6328e0df6d req-851e1d44-db63-4867-bacb-bd7aebd3a0af service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Received unexpected event network-vif-plugged-2cb265c0-d6bd-45df-8f3f-644e528b3649 for instance with vm_state building and task_state spawning.
Oct 26 17:26:38 user nova-compute[75113]: INFO nova.compute.manager [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Took 5.60 seconds to spawn the instance on the hypervisor.
Oct 26 17:26:38 user nova-compute[75113]: DEBUG nova.compute.manager [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:26:39 user nova-compute[75113]: INFO nova.compute.manager [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Took 6.16 seconds to build instance.
Oct 26 17:26:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-4d99e5c9-46ac-4a41-bc30-b9043e2b0bf8 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.249s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:26:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:42 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:26:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:48 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f642e634-0efc-4ed2-aa00-ba2d3979b353 is timed out.
Oct 26 17:26:48 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Successfully detached device vdc from instance f642e634-0efc-4ed2-aa00-ba2d3979b353 from the live domain config.
Oct 26 17:26:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USOZEgde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:26:48 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0090370-dd09-4c68-bd86-18ba01ab4f22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:26:48 user nova-compute[75113]: No targets found.
Oct 26 17:26:48 user nova-compute[75113]: iSNS:
Oct 26 17:26:48 user nova-compute[75113]: No targets found.
Oct 26 17:26:48 user nova-compute[75113]: STATIC:
Oct 26 17:26:48 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b
Oct 26 17:26:48 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:26:48 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:26:48 user nova-compute[75113]: FIRMWARE:
Oct 26 17:26:48 user nova-compute[75113]: No targets found.
Oct 26 17:26:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:26:48 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:26:48 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcba767-5de5-4eed-92c0-e462742a02dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4412d9b-9276-46d5-ae49-142b14df1474]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b (non-flash)
Oct 26 17:26:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b (non-flash)
Oct 26 17:26:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914212710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b'): ({'sdc'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Removing single pathed devices sdc {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b627bb-6a3f-47cc-8a67-774505f1bf28]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05683be-18fc-4bb1-a8f9-ee9a4f16a95b]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Flushing IO for device /dev/sdc {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f7a2d2-c39d-4b19-84dd-9b73862ff393]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[53019227-f0f4-4067-b108-d39a14222485]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c93895d-e7b3-41ec-9531-4e00181d41f1]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[931f6b2f-1598-41fc-a5f7-1fa93a4a993f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b, portal: 172.16.0.220,3260]
Oct 26 17:26:48 user nova-compute[75113]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b, portal: 172.16.0.220,3260] successful.
Oct 26 17:26:48 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4b6f77-b530-478d-aace-04b620a8107b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdf97b8-3e2b-46ec-ba04-567401c75be3]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] <== disconnect_volume: return (313ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:26:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:26:49 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'flavor' on Instance uuid f642e634-0efc-4ed2-aa00-ba2d3979b353 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:26:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2e8c4683-1960-4270-b7d8-1720043638a8 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.981s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:26:50 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:26:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:26:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:26:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:17 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:27:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:17 user nova-compute[75113]: INFO nova.compute.manager [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Terminating instance
Oct 26 17:27:17 user nova-compute[75113]: DEBUG nova.compute.manager [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:27:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-f342d62c-c6d6-4687-8ef9-5d486458ce72 req-c026c21c-dfa0-45b7-8df7-c6c0a31ef60f service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-vif-unplugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f342d62c-c6d6-4687-8ef9-5d486458ce72 req-c026c21c-dfa0-45b7-8df7-c6c0a31ef60f service nova] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f342d62c-c6d6-4687-8ef9-5d486458ce72 req-c026c21c-dfa0-45b7-8df7-c6c0a31ef60f service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f342d62c-c6d6-4687-8ef9-5d486458ce72 req-c026c21c-dfa0-45b7-8df7-c6c0a31ef60f service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-f342d62c-c6d6-4687-8ef9-5d486458ce72 req-c026c21c-dfa0-45b7-8df7-c6c0a31ef60f service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] No waiting events found dispatching network-vif-unplugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-f342d62c-c6d6-4687-8ef9-5d486458ce72 req-c026c21c-dfa0-45b7-8df7-c6c0a31ef60f service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-vif-unplugged-a579d831-4c13-4c14-bb83-d0eae63bfecc for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:27:18 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Instance destroyed successfully.
Oct 26 17:27:18 user nova-compute[75113]: DEBUG nova.objects.instance [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'resources' on Instance uuid f642e634-0efc-4ed2-aa00-ba2d3979b353 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1601727451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1601727451',id=38,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/ti9SgfZo5ZxnMZs4A1FtLos6PaWPOYvz9rLDjIoS/K8b7t1GcFvLTOt05j0mGqfEFNT1P6dHavVXrlCDiUYNXeNT+tgzbSr80cX4zrTu374SJVw79aSaRs7elSBabnA==',key_name='tempest-keypair-1190114021',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b425dca1e9645ad99fea4b666b01fab',ramdisk_id='',reservation_id='r-uwmu4xiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1688117037',owner_user_name='tempest-AttachVolumeShelveTestJSON-1688117037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b16af3affdf47f596f944cb83f772e9',uuid=f642e634-0efc-4ed2-aa00-ba2d3979b353,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converting VIF {"id": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "address": "fa:16:3e:25:f2:8d", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa579d831-4c", "ovs_interfaceid": "a579d831-4c13-4c14-bb83-d0eae63bfecc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG os_vif [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa579d831-4c, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d852174-b8b8-4e33-a5f4-1f4f876e48da) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:27:18 user nova-compute[75113]: INFO os_vif [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:f2:8d,bridge_name='br-int',has_traffic_filtering=True,id=a579d831-4c13-4c14-bb83-d0eae63bfecc,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa579d831-4c')
Oct 26 17:27:18 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Deleting instance files /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353_del
Oct 26 17:27:18 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Deletion of /opt/stack/data/nova/instances/f642e634-0efc-4ed2-aa00-ba2d3979b353_del complete
Oct 26 17:27:18 user nova-compute[75113]: INFO nova.compute.manager [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 17:27:18 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:27:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:19 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:27:19 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Took 0.65 seconds to deallocate network for instance.
Oct 26 17:27:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:19 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:27:19 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:27:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:19 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Deleted allocations for instance f642e634-0efc-4ed2-aa00-ba2d3979b353
Oct 26 17:27:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b6b7146e-99b4-491c-9b92-01ba58468704 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.892s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-05e7fc34-bc16-4c61-a826-f54e0f7eed81 req-9cfd99b6-265d-4c45-8dcc-75c5779cc63a service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:27:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-05e7fc34-bc16-4c61-a826-f54e0f7eed81 req-9cfd99b6-265d-4c45-8dcc-75c5779cc63a service nova] Acquiring lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-05e7fc34-bc16-4c61-a826-f54e0f7eed81 req-9cfd99b6-265d-4c45-8dcc-75c5779cc63a service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-05e7fc34-bc16-4c61-a826-f54e0f7eed81 req-9cfd99b6-265d-4c45-8dcc-75c5779cc63a service nova] Lock "f642e634-0efc-4ed2-aa00-ba2d3979b353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-05e7fc34-bc16-4c61-a826-f54e0f7eed81 req-9cfd99b6-265d-4c45-8dcc-75c5779cc63a service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] No waiting events found dispatching network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:27:20 user nova-compute[75113]: WARNING nova.compute.manager [req-05e7fc34-bc16-4c61-a826-f54e0f7eed81 req-9cfd99b6-265d-4c45-8dcc-75c5779cc63a service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received unexpected event network-vif-plugged-a579d831-4c13-4c14-bb83-d0eae63bfecc for instance with vm_state deleted and task_state None.
Oct 26 17:27:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-05e7fc34-bc16-4c61-a826-f54e0f7eed81 req-9cfd99b6-265d-4c45-8dcc-75c5779cc63a service nova] [instance: f642e634-0efc-4ed2-aa00-ba2d3979b353] Received event network-vif-deleted-a579d831-4c13-4c14-bb83-d0eae63bfecc {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:27:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:27:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:27:26 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:27:27 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:27:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-531e3be1-9424-415d-b932-db7cd0bd7873 req-8931402d-221d-481e-a7ba-7568dffae786 service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Received event network-changed-2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:27:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-531e3be1-9424-415d-b932-db7cd0bd7873 req-8931402d-221d-481e-a7ba-7568dffae786 service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Refreshing instance network info cache due to event network-changed-2e7c529d-8456-49e4-be69-66b8b4f86d00. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:27:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-531e3be1-9424-415d-b932-db7cd0bd7873 req-8931402d-221d-481e-a7ba-7568dffae786 service nova] Acquiring lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:27:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-531e3be1-9424-415d-b932-db7cd0bd7873 req-8931402d-221d-481e-a7ba-7568dffae786 service nova] Acquired lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:27:27 user nova-compute[75113]: DEBUG nova.network.neutron [req-531e3be1-9424-415d-b932-db7cd0bd7873 req-8931402d-221d-481e-a7ba-7568dffae786 service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Refreshing network info cache for port 2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:27:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:27 user nova-compute[75113]: DEBUG nova.network.neutron [req-531e3be1-9424-415d-b932-db7cd0bd7873 req-8931402d-221d-481e-a7ba-7568dffae786 service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Updated VIF entry in instance network info cache for port 2e7c529d-8456-49e4-be69-66b8b4f86d00. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:27:27 user nova-compute[75113]: DEBUG nova.network.neutron [req-531e3be1-9424-415d-b932-db7cd0bd7873 req-8931402d-221d-481e-a7ba-7568dffae786 service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Updating instance_info_cache with network_info: [{"id": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "address": "fa:16:3e:dd:45:07", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c529d-84", "ovs_interfaceid": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:27:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-531e3be1-9424-415d-b932-db7cd0bd7873 req-8931402d-221d-481e-a7ba-7568dffae786 service nova] Releasing lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:27:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:29 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:27:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:29 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:27:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:30 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:30 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:27:30 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:27:30 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8602MB free_disk=25.076129913330078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:27:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:30 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:27:30 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 97199d01-06b9-4e73-a23e-2b6110544afe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:27:30 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:27:30 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:27:30 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:27:30 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:27:30 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:27:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "3bde34c7-f234-4c16-b631-224c029ba6e8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:31 user nova-compute[75113]: INFO nova.compute.manager [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Unshelving
Oct 26 17:27:31 user nova-compute[75113]: INFO nova.virt.block_device [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Booting with volume 9aedb1cc-553c-461e-919f-f712e7e122ad at /dev/vda
Oct 26 17:27:31 user nova-compute[75113]: DEBUG os_brick.utils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7509c6-43d5-4267-86c3-2455957473c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70ea6b7-80d7-4c9f-911c-8d58aba27410]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe8b5e6-038a-4457-82e6-bff9073e8245]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3d330c-7df4-42f7-ad51-c7aae0f39a8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:27:31 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b741f2-488b-42a0-85be-a3b649fcf1cf]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG os_brick.utils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating existing volume attachment record: 239cab90-b295-4aac-8f1b-be4cf6ae6312 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:27:31 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:27:32 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Updating instance_info_cache with network_info: [{"id": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "address": "fa:16:3e:dd:45:07", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c529d-84", "ovs_interfaceid": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:27:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:27:32 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:27:32 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:27:32 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:27:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG nova.objects.instance [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'flavor' on Instance uuid 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:33 user nova-compute[75113]: INFO nova.compute.manager [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Attaching volume 8a2182c6-bdf0-4849-9399-88ef097f4a8e to /dev/vdb
Oct 26 17:27:33 user nova-compute[75113]: DEBUG os_brick.utils [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc59e13-8c55-44ed-ad4d-d8d8557506e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e70d846-ca8f-44ca-be74-cf84176a4261]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d562d1a-16ee-4bc6-b998-18a169929307]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85aa03c-dd9d-4845-9a2c-3e5fec474447]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:27:33 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:27:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef71c9b-fd24-4fde-b8af-dab5a72b32f0]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG os_brick.utils [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:27:33 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Updating existing volume attachment record: 8c22f3eb-6ae0-4990-8e23-1a63a95d9551 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:27:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:42 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:27:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:50 user nova-compute[75113]: DEBUG nova.objects.instance [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lazy-loading 'pci_requests' on Instance uuid 3bde34c7-f234-4c16-b631-224c029ba6e8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:27:50 user nova-compute[75113]: DEBUG nova.objects.instance [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lazy-loading 'numa_topology' on Instance uuid 3bde34c7-f234-4c16-b631-224c029ba6e8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:27:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:27:50 user nova-compute[75113]: INFO nova.compute.claims [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Claim successful on node user
Oct 26 17:27:50 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:27:50 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:27:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:50 user nova-compute[75113]: INFO nova.network.neutron [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating port 6af72c21-9dc2-4a66-b0fe-792b2ff617fe with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquired lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.network.neutron [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-ed09f898-42e8-452a-b87d-f50a9c3bbea3 req-5de541a1-12a2-487f-a82f-7c46a2e4ead9 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-changed-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-ed09f898-42e8-452a-b87d-f50a9c3bbea3 req-5de541a1-12a2-487f-a82f-7c46a2e4ead9 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Refreshing instance network info cache due to event network-changed-6af72c21-9dc2-4a66-b0fe-792b2ff617fe. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ed09f898-42e8-452a-b87d-f50a9c3bbea3 req-5de541a1-12a2-487f-a82f-7c46a2e4ead9 service nova] Acquiring lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.network.neutron [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating instance_info_cache with network_info: [{"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Releasing lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:27:51 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Creating image(s)
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Ensure instance console log exists: /opt/stack/data/nova/instances/3bde34c7-f234-4c16-b631-224c029ba6e8/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Start _get_guest_xml network_info=[{"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '239cab90-b295-4aac-8f1b-be4cf6ae6312', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXDzWLga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3bde34c7-f234-4c16-b631-224c029ba6e8', 'attached_at': '', 'detached_at': '', 'volume_id': '9aedb1cc-553c-461e-919f-f712e7e122ad', 'serial': '9aedb1cc-553c-461e-919f-f712e7e122ad'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ed09f898-42e8-452a-b87d-f50a9c3bbea3 req-5de541a1-12a2-487f-a82f-7c46a2e4ead9 service nova] Acquired lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.network.neutron [req-ed09f898-42e8-452a-b87d-f50a9c3bbea3 req-5de541a1-12a2-487f-a82f-7c46a2e4ead9 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Refreshing network info cache for port 6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:27:51 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:27:51 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.objects.instance [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3bde34c7-f234-4c16-b631-224c029ba6e8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.objects.base [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Object Instance<3bde34c7-f234-4c16-b631-224c029ba6e8> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXDzWLga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:27:51 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:27:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:27:51 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:27:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:27:51 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cc0012-dcb1-497f-9622-3c85e44a02c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:27:51 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b5d445-ea1a-4b0b-9ced-413630f8fb36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad] added
Oct 26 17:27:51 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe18e954-c5dc-4d23-827a-600e853269b7]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca16fa1f-4272-4bcd-90b8-478de3d59e2f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXDzWLga {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXDzWLga" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5279c500-4c70-41ef-bf32-2597c7c16476]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vXDzWLga'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[38529008-e874-4c6b-8412-03115776b197]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f7f505-df21-47dc-89ab-52915b8dbded]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:27:51 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:27:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:27:51 user nova-compute[75113]:  {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:27:51 user nova-compute[75113]: WARNING os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 17:27:51 user nova-compute[75113]: 
Oct 26 17:27:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae1faf2-f960-4772-acb6-bd86ef4b9ba6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260]
Oct 26 17:27:52 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260] successful.
Oct 26 17:27:52 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8087f9-a21e-4837-b08f-b037f4359d96]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0267bfa7-c4a5-4cc4-99f2-742b59589591]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:27:52 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:27:52 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca14aca-8aa9-43c8-a3f1-4e3edd8f97ea]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG nova.network.neutron [req-ed09f898-42e8-452a-b87d-f50a9c3bbea3 req-5de541a1-12a2-487f-a82f-7c46a2e4ead9 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updated VIF entry in instance network info cache for port 6af72c21-9dc2-4a66-b0fe-792b2ff617fe. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG nova.network.neutron [req-ed09f898-42e8-452a-b87d-f50a9c3bbea3 req-5de541a1-12a2-487f-a82f-7c46a2e4ead9 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating instance_info_cache with network_info: [{"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ed09f898-42e8-452a-b87d-f50a9c3bbea3 req-5de541a1-12a2-487f-a82f-7c46a2e4ead9 service nova] Releasing lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:27:52 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoZOlNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:27:52 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:27:52 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXDzWLga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23532616561356233', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532616561356233', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.526s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:27:53 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:27:53 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d50fefe-66fa-43ef-8423-859f0a6dca02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:27:53 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:23:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1599500593',display_name='tempest-TestShelveInstance-server-1599500593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1599500593',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1332116264',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:24:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='309b039fa49c4e399504dcdcff86724e',ramdisk_id='',reservation_id='r-t2nawjxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1069964257',owner_user_name='tempest-TestShelveInstance-1069964257-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:27:31Z,user_data=None,user_id='d5efe78e0cd34414853f640e4c850e5d',uuid=3bde34c7-f234-4c16-b631-224c029ba6e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Converting VIF {"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG nova.objects.instance [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bde34c7-f234-4c16-b631-224c029ba6e8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG nova.objects.base [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Object Instance<3bde34c7-f234-4c16-b631-224c029ba6e8> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:27:53 user nova-compute[75113]:   <uuid>3bde34c7-f234-4c16-b631-224c029ba6e8</uuid>
Oct 26 17:27:53 user nova-compute[75113]:   <name>instance-00000028</name>
Oct 26 17:27:53 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:27:53 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:27:53 user nova-compute[75113]:   <metadata>
Oct 26 17:27:53 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:27:53 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:27:53 user nova-compute[75113]:       <nova:name>tempest-TestShelveInstance-server-1599500593</nova:name>
Oct 26 17:27:53 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:27:51</nova:creationTime>
Oct 26 17:27:53 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:27:53 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:27:53 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:27:53 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:27:53 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:27:53 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:27:53 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:27:53 user nova-compute[75113]:       <nova:owner>
Oct 26 17:27:53 user nova-compute[75113]:         <nova:user uuid="d5efe78e0cd34414853f640e4c850e5d">tempest-TestShelveInstance-1069964257-project-member</nova:user>
Oct 26 17:27:53 user nova-compute[75113]:         <nova:project uuid="309b039fa49c4e399504dcdcff86724e">tempest-TestShelveInstance-1069964257</nova:project>
Oct 26 17:27:53 user nova-compute[75113]:       </nova:owner>
Oct 26 17:27:53 user nova-compute[75113]:       <nova:ports>
Oct 26 17:27:53 user nova-compute[75113]:         <nova:port uuid="6af72c21-9dc2-4a66-b0fe-792b2ff617fe">
Oct 26 17:27:53 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 17:27:53 user nova-compute[75113]:         </nova:port>
Oct 26 17:27:53 user nova-compute[75113]:       </nova:ports>
Oct 26 17:27:53 user nova-compute[75113]:     </nova:instance>
Oct 26 17:27:53 user nova-compute[75113]:   </metadata>
Oct 26 17:27:53 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:27:53 user nova-compute[75113]:     <system>
Oct 26 17:27:53 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:27:53 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:27:53 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:27:53 user nova-compute[75113]:       <entry name="serial">3bde34c7-f234-4c16-b631-224c029ba6e8</entry>
Oct 26 17:27:53 user nova-compute[75113]:       <entry name="uuid">3bde34c7-f234-4c16-b631-224c029ba6e8</entry>
Oct 26 17:27:53 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:27:53 user nova-compute[75113]:     </system>
Oct 26 17:27:53 user nova-compute[75113]:   </sysinfo>
Oct 26 17:27:53 user nova-compute[75113]:   <os>
Oct 26 17:27:53 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:27:53 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:27:53 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:27:53 user nova-compute[75113]:   </os>
Oct 26 17:27:53 user nova-compute[75113]:   <features>
Oct 26 17:27:53 user nova-compute[75113]:     <acpi/>
Oct 26 17:27:53 user nova-compute[75113]:     <apic/>
Oct 26 17:27:53 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:27:53 user nova-compute[75113]:   </features>
Oct 26 17:27:53 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:27:53 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:27:53 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:27:53 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:27:53 user nova-compute[75113]:   </clock>
Oct 26 17:27:53 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:27:53 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:27:53 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:27:53 user nova-compute[75113]:   </cpu>
Oct 26 17:27:53 user nova-compute[75113]:   <devices>
Oct 26 17:27:53 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:27:53 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:27:53 user nova-compute[75113]:       <source dev="/dev/sdb"/>
Oct 26 17:27:53 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:27:53 user nova-compute[75113]:       <serial>9aedb1cc-553c-461e-919f-f712e7e122ad</serial>
Oct 26 17:27:53 user nova-compute[75113]:     </disk>
Oct 26 17:27:53 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:27:53 user nova-compute[75113]:       <mac address="fa:16:3e:bf:82:80"/>
Oct 26 17:27:53 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:27:53 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:27:53 user nova-compute[75113]:       <target dev="tap6af72c21-9d"/>
Oct 26 17:27:53 user nova-compute[75113]:     </interface>
Oct 26 17:27:53 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:27:53 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/3bde34c7-f234-4c16-b631-224c029ba6e8/console.log" append="off"/>
Oct 26 17:27:53 user nova-compute[75113]:     </serial>
Oct 26 17:27:53 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:27:53 user nova-compute[75113]:     <video>
Oct 26 17:27:53 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:27:53 user nova-compute[75113]:     </video>
Oct 26 17:27:53 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:27:53 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:27:53 user nova-compute[75113]:     </rng>
Oct 26 17:27:53 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:27:53 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:27:53 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:27:53 user nova-compute[75113]:     </memballoon>
Oct 26 17:27:53 user nova-compute[75113]:   </devices>
Oct 26 17:27:53 user nova-compute[75113]: </domain>
Oct 26 17:27:53 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:23:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1599500593',display_name='tempest-TestShelveInstance-server-1599500593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1599500593',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1332116264',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:24:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='309b039fa49c4e399504dcdcff86724e',ramdisk_id='',reservation_id='r-t2nawjxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1069964257',owner_user_name='tempest-TestShelveInstance-1069964257-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:27:31Z,user_data=None,user_id='d5efe78e0cd34414853f640e4c850e5d',uuid=3bde34c7-f234-4c16-b631-224c029ba6e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Converting VIF {"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_vif [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c614eb94-7ff8-4d8a-affd-8a58716a7404]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e] added
Oct 26 17:27:53 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fb736d5-fc49-5944-9af1-d4a4941a2915', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6af72c21-9d, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6af72c21-9d, col_values=(('qos', UUID('e62c10e4-8378-4472-ac84-4811f2d0bb80')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6af72c21-9d, col_values=(('external_ids', {'iface-id': '6af72c21-9dc2-4a66-b0fe-792b2ff617fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:82:80', 'vm-uuid': '3bde34c7-f234-4c16-b631-224c029ba6e8'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[84745a64-7cf7-450d-860f-f900271f1bb5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:53 user nova-compute[75113]: INFO os_vif [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d')
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae56a54-f359-4021-898b-2c1738d02214]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uoZOlNCW {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uoZOlNCW" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfd8e79-5a8d-4f66-8788-0a83962fe58d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uoZOlNCW'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c799b7f-9908-4d04-a555-9118c40bb8a3]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] No VIF found with MAC fa:16:3e:bf:82:80, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[261aa076-2626-47d8-8376-f9c1416581b8]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:27:53 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:27:53 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d1e7dc-57e1-44fb-bac3-5784417d5069]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e, portal: 172.16.0.220,3260]
Oct 26 17:27:53 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e, portal: 172.16.0.220,3260] successful.
Oct 26 17:27:53 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae8c629-176d-4ade-a118-fe0bd9e12cc5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac92e5fc-f128-4e9f-8dd5-bedeef6cda9e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:27:53 user nova-compute[75113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:27:53 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:27:53 user nova-compute[75113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:27:53 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc30c3ac-2d35-483d-8ff1-4d57cbeef26d]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:27:53 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoZOlNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] <== connect_volume: return (1848ms) {'type': 'block', 'scsi_wwn': '23466633832383362', 'path': '/dev/sdc'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466633832383362', 'path': '/dev/sdc'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG nova.objects.instance [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'flavor' on Instance uuid 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:27:54 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:27:54 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:27:54 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:27:54 user nova-compute[75113]:   <serial>8a2182c6-bdf0-4849-9399-88ef097f4a8e</serial>
Oct 26 17:27:54 user nova-compute[75113]: </disk>
Oct 26 17:27:54 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-4c2e26da-fb6b-4739-b351-b456c79a2302 req-61a50dac-ddb0-4355-949a-96301d349fe0 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4c2e26da-fb6b-4739-b351-b456c79a2302 req-61a50dac-ddb0-4355-949a-96301d349fe0 service nova] Acquiring lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4c2e26da-fb6b-4739-b351-b456c79a2302 req-61a50dac-ddb0-4355-949a-96301d349fe0 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4c2e26da-fb6b-4739-b351-b456c79a2302 req-61a50dac-ddb0-4355-949a-96301d349fe0 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-4c2e26da-fb6b-4739-b351-b456c79a2302 req-61a50dac-ddb0-4355-949a-96301d349fe0 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] No waiting events found dispatching network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:27:54 user nova-compute[75113]: WARNING nova.compute.manager [req-4c2e26da-fb6b-4739-b351-b456c79a2302 req-61a50dac-ddb0-4355-949a-96301d349fe0 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received unexpected event network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 17:27:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:27:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:27:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No VIF found with MAC fa:16:3e:dd:45:07, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:27:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-13ad77ac-e67a-4d63-baf5-1383217fec16 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.044s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-ef8cee2c-bc14-4276-883c-e7fed831984b req-e0beab9d-83e5-412f-9714-75a067ed3209 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:27:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ef8cee2c-bc14-4276-883c-e7fed831984b req-e0beab9d-83e5-412f-9714-75a067ed3209 service nova] Acquiring lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ef8cee2c-bc14-4276-883c-e7fed831984b req-e0beab9d-83e5-412f-9714-75a067ed3209 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ef8cee2c-bc14-4276-883c-e7fed831984b req-e0beab9d-83e5-412f-9714-75a067ed3209 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-ef8cee2c-bc14-4276-883c-e7fed831984b req-e0beab9d-83e5-412f-9714-75a067ed3209 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] No waiting events found dispatching network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:27:56 user nova-compute[75113]: WARNING nova.compute.manager [req-ef8cee2c-bc14-4276-883c-e7fed831984b req-e0beab9d-83e5-412f-9714-75a067ed3209 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received unexpected event network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 17:27:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:27:57 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:27:57 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Instance spawned successfully.
Oct 26 17:27:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:27:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-16120d68-bd2c-4f7c-87bc-703278f5c0c4 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.133s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:27:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "b1719df0-f4cc-4581-a823-5ba3bf388a05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:58 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:27:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:58 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:58 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:27:58 user nova-compute[75113]: INFO nova.compute.claims [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Claim successful on node user
Oct 26 17:27:59 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:27:59 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:27:59 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG nova.policy [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47bb03390d7d489d91750653f399125f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30bd0e84d1448158ca783491ed372f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:27:59 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Creating image(s)
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "/opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "/opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.200s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.196s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk 1073741824" returned: 0 in 0.050s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:27:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Successfully created port: 70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Cannot resize image /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Ensure instance console log exists: /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Successfully updated port: 70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "refresh_cache-b1719df0-f4cc-4581-a823-5ba3bf388a05" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquired lock "refresh_cache-b1719df0-f4cc-4581-a823-5ba3bf388a05" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-c5aae2d1-61a8-48c3-a4eb-d0c783591619 req-eacbaf31-77b4-4a00-8d3c-9f1d83536f63 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Received event network-changed-70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG nova.compute.manager [req-c5aae2d1-61a8-48c3-a4eb-d0c783591619 req-eacbaf31-77b4-4a00-8d3c-9f1d83536f63 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Refreshing instance network info cache due to event network-changed-70be792f-4ef9-44c2-88ba-65d93df91382. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c5aae2d1-61a8-48c3-a4eb-d0c783591619 req-eacbaf31-77b4-4a00-8d3c-9f1d83536f63 service nova] Acquiring lock "refresh_cache-b1719df0-f4cc-4581-a823-5ba3bf388a05" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:28:00 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.network.neutron [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Updating instance_info_cache with network_info: [{"id": "70be792f-4ef9-44c2-88ba-65d93df91382", "address": "fa:16:3e:76:41:7b", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70be792f-4e", "ovs_interfaceid": "70be792f-4ef9-44c2-88ba-65d93df91382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Releasing lock "refresh_cache-b1719df0-f4cc-4581-a823-5ba3bf388a05" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Instance network_info: |[{"id": "70be792f-4ef9-44c2-88ba-65d93df91382", "address": "fa:16:3e:76:41:7b", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70be792f-4e", "ovs_interfaceid": "70be792f-4ef9-44c2-88ba-65d93df91382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c5aae2d1-61a8-48c3-a4eb-d0c783591619 req-eacbaf31-77b4-4a00-8d3c-9f1d83536f63 service nova] Acquired lock "refresh_cache-b1719df0-f4cc-4581-a823-5ba3bf388a05" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.network.neutron [req-c5aae2d1-61a8-48c3-a4eb-d0c783591619 req-eacbaf31-77b4-4a00-8d3c-9f1d83536f63 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Refreshing network info cache for port 70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Start _get_guest_xml network_info=[{"id": "70be792f-4ef9-44c2-88ba-65d93df91382", "address": "fa:16:3e:76:41:7b", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70be792f-4e", "ovs_interfaceid": "70be792f-4ef9-44c2-88ba-65d93df91382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:28:01 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:28:01 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1689848409',display_name='tempest-AttachVolumeNegativeTest-server-1689848409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1689848409',id=43,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/yH2N8fn59zWGEkAipX93uN+5CjCHBvkRBTCrZPtjs30uTIucOhXMCkNkhVZQVka4f7vHc7jmWQS9yHlS+oOPznlv6EHb7Qc1DjfYA3b5kK/Y/tdFs8eXdVF0QxUlXrg==',key_name='tempest-keypair-1236807554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30bd0e84d1448158ca783491ed372f5',ramdisk_id='',reservation_id='r-jtvabckg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1111816565',owner_user_name='tempest-AttachVolumeNegativeTest-1111816565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:27:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47bb03390d7d489d91750653f399125f',uuid=b1719df0-f4cc-4581-a823-5ba3bf388a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70be792f-4ef9-44c2-88ba-65d93df91382", "address": "fa:16:3e:76:41:7b", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70be792f-4e", "ovs_interfaceid": "70be792f-4ef9-44c2-88ba-65d93df91382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converting VIF {"id": "70be792f-4ef9-44c2-88ba-65d93df91382", "address": "fa:16:3e:76:41:7b", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70be792f-4e", "ovs_interfaceid": "70be792f-4ef9-44c2-88ba-65d93df91382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:41:7b,bridge_name='br-int',has_traffic_filtering=True,id=70be792f-4ef9-44c2-88ba-65d93df91382,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70be792f-4e') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.objects.instance [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'pci_devices' on Instance uuid b1719df0-f4cc-4581-a823-5ba3bf388a05 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:28:01 user nova-compute[75113]:   <uuid>b1719df0-f4cc-4581-a823-5ba3bf388a05</uuid>
Oct 26 17:28:01 user nova-compute[75113]:   <name>instance-0000002b</name>
Oct 26 17:28:01 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:28:01 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:28:01 user nova-compute[75113]:   <metadata>
Oct 26 17:28:01 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:28:01 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:28:01 user nova-compute[75113]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1689848409</nova:name>
Oct 26 17:28:01 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:28:01</nova:creationTime>
Oct 26 17:28:01 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:28:01 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:28:01 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:28:01 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:28:01 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:28:01 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:28:01 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:28:01 user nova-compute[75113]:       <nova:owner>
Oct 26 17:28:01 user nova-compute[75113]:         <nova:user uuid="47bb03390d7d489d91750653f399125f">tempest-AttachVolumeNegativeTest-1111816565-project-member</nova:user>
Oct 26 17:28:01 user nova-compute[75113]:         <nova:project uuid="c30bd0e84d1448158ca783491ed372f5">tempest-AttachVolumeNegativeTest-1111816565</nova:project>
Oct 26 17:28:01 user nova-compute[75113]:       </nova:owner>
Oct 26 17:28:01 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:28:01 user nova-compute[75113]:       <nova:ports>
Oct 26 17:28:01 user nova-compute[75113]:         <nova:port uuid="70be792f-4ef9-44c2-88ba-65d93df91382">
Oct 26 17:28:01 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 17:28:01 user nova-compute[75113]:         </nova:port>
Oct 26 17:28:01 user nova-compute[75113]:       </nova:ports>
Oct 26 17:28:01 user nova-compute[75113]:     </nova:instance>
Oct 26 17:28:01 user nova-compute[75113]:   </metadata>
Oct 26 17:28:01 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:28:01 user nova-compute[75113]:     <system>
Oct 26 17:28:01 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:28:01 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:28:01 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:28:01 user nova-compute[75113]:       <entry name="serial">b1719df0-f4cc-4581-a823-5ba3bf388a05</entry>
Oct 26 17:28:01 user nova-compute[75113]:       <entry name="uuid">b1719df0-f4cc-4581-a823-5ba3bf388a05</entry>
Oct 26 17:28:01 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:28:01 user nova-compute[75113]:     </system>
Oct 26 17:28:01 user nova-compute[75113]:   </sysinfo>
Oct 26 17:28:01 user nova-compute[75113]:   <os>
Oct 26 17:28:01 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:28:01 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:28:01 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:28:01 user nova-compute[75113]:   </os>
Oct 26 17:28:01 user nova-compute[75113]:   <features>
Oct 26 17:28:01 user nova-compute[75113]:     <acpi/>
Oct 26 17:28:01 user nova-compute[75113]:     <apic/>
Oct 26 17:28:01 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:28:01 user nova-compute[75113]:   </features>
Oct 26 17:28:01 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:28:01 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:28:01 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:28:01 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:28:01 user nova-compute[75113]:   </clock>
Oct 26 17:28:01 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:28:01 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:28:01 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:28:01 user nova-compute[75113]:   </cpu>
Oct 26 17:28:01 user nova-compute[75113]:   <devices>
Oct 26 17:28:01 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:28:01 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:28:01 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk"/>
Oct 26 17:28:01 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:28:01 user nova-compute[75113]:     </disk>
Oct 26 17:28:01 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:28:01 user nova-compute[75113]:       <mac address="fa:16:3e:76:41:7b"/>
Oct 26 17:28:01 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:28:01 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:28:01 user nova-compute[75113]:       <target dev="tap70be792f-4e"/>
Oct 26 17:28:01 user nova-compute[75113]:     </interface>
Oct 26 17:28:01 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:28:01 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/console.log" append="off"/>
Oct 26 17:28:01 user nova-compute[75113]:     </serial>
Oct 26 17:28:01 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:28:01 user nova-compute[75113]:     <video>
Oct 26 17:28:01 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:28:01 user nova-compute[75113]:     </video>
Oct 26 17:28:01 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:28:01 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:28:01 user nova-compute[75113]:     </rng>
Oct 26 17:28:01 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:28:01 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:28:01 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:28:01 user nova-compute[75113]:     </memballoon>
Oct 26 17:28:01 user nova-compute[75113]:   </devices>
Oct 26 17:28:01 user nova-compute[75113]: </domain>
Oct 26 17:28:01 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1689848409',display_name='tempest-AttachVolumeNegativeTest-server-1689848409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1689848409',id=43,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/yH2N8fn59zWGEkAipX93uN+5CjCHBvkRBTCrZPtjs30uTIucOhXMCkNkhVZQVka4f7vHc7jmWQS9yHlS+oOPznlv6EHb7Qc1DjfYA3b5kK/Y/tdFs8eXdVF0QxUlXrg==',key_name='tempest-keypair-1236807554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30bd0e84d1448158ca783491ed372f5',ramdisk_id='',reservation_id='r-jtvabckg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1111816565',owner_user_name='tempest-AttachVolumeNegativeTest-1111816565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:27:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47bb03390d7d489d91750653f399125f',uuid=b1719df0-f4cc-4581-a823-5ba3bf388a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70be792f-4ef9-44c2-88ba-65d93df91382", "address": "fa:16:3e:76:41:7b", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70be792f-4e", "ovs_interfaceid": "70be792f-4ef9-44c2-88ba-65d93df91382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converting VIF {"id": "70be792f-4ef9-44c2-88ba-65d93df91382", "address": "fa:16:3e:76:41:7b", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70be792f-4e", "ovs_interfaceid": "70be792f-4ef9-44c2-88ba-65d93df91382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:41:7b,bridge_name='br-int',has_traffic_filtering=True,id=70be792f-4ef9-44c2-88ba-65d93df91382,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70be792f-4e') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG os_vif [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:41:7b,bridge_name='br-int',has_traffic_filtering=True,id=70be792f-4ef9-44c2-88ba-65d93df91382,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70be792f-4e') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45399ae6-364b-54ae-a2a6-3f143cf8fa33', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70be792f-4e, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70be792f-4e, col_values=(('qos', UUID('3073f7f2-11ea-470e-a79f-fc0d47750e58')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70be792f-4e, col_values=(('external_ids', {'iface-id': '70be792f-4ef9-44c2-88ba-65d93df91382', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:41:7b', 'vm-uuid': 'b1719df0-f4cc-4581-a823-5ba3bf388a05'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:01 user nova-compute[75113]: INFO os_vif [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:41:7b,bridge_name='br-int',has_traffic_filtering=True,id=70be792f-4ef9-44c2-88ba-65d93df91382,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70be792f-4e')
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No VIF found with MAC fa:16:3e:76:41:7b, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.network.neutron [req-c5aae2d1-61a8-48c3-a4eb-d0c783591619 req-eacbaf31-77b4-4a00-8d3c-9f1d83536f63 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Updated VIF entry in instance network info cache for port 70be792f-4ef9-44c2-88ba-65d93df91382. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG nova.network.neutron [req-c5aae2d1-61a8-48c3-a4eb-d0c783591619 req-eacbaf31-77b4-4a00-8d3c-9f1d83536f63 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Updating instance_info_cache with network_info: [{"id": "70be792f-4ef9-44c2-88ba-65d93df91382", "address": "fa:16:3e:76:41:7b", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70be792f-4e", "ovs_interfaceid": "70be792f-4ef9-44c2-88ba-65d93df91382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:28:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c5aae2d1-61a8-48c3-a4eb-d0c783591619 req-eacbaf31-77b4-4a00-8d3c-9f1d83536f63 service nova] Releasing lock "refresh_cache-b1719df0-f4cc-4581-a823-5ba3bf388a05" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:28:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-293151b1-ffec-49ec-9866-28e5651a6942 req-ac37f39c-d542-4b07-a282-da6532ee2eb9 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Received event network-vif-plugged-70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:28:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-293151b1-ffec-49ec-9866-28e5651a6942 req-ac37f39c-d542-4b07-a282-da6532ee2eb9 service nova] Acquiring lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-293151b1-ffec-49ec-9866-28e5651a6942 req-ac37f39c-d542-4b07-a282-da6532ee2eb9 service nova] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-293151b1-ffec-49ec-9866-28e5651a6942 req-ac37f39c-d542-4b07-a282-da6532ee2eb9 service nova] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-293151b1-ffec-49ec-9866-28e5651a6942 req-ac37f39c-d542-4b07-a282-da6532ee2eb9 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] No waiting events found dispatching network-vif-plugged-70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:28:03 user nova-compute[75113]: WARNING nova.compute.manager [req-293151b1-ffec-49ec-9866-28e5651a6942 req-ac37f39c-d542-4b07-a282-da6532ee2eb9 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Received unexpected event network-vif-plugged-70be792f-4ef9-44c2-88ba-65d93df91382 for instance with vm_state building and task_state spawning.
Oct 26 17:28:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:05 user nova-compute[75113]: DEBUG nova.compute.manager [req-2821ba49-d9c1-4650-894f-b4e4bffcdba9 req-449d4a0e-2a09-409f-b054-273042f3100e service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Received event network-vif-plugged-70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:28:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2821ba49-d9c1-4650-894f-b4e4bffcdba9 req-449d4a0e-2a09-409f-b054-273042f3100e service nova] Acquiring lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2821ba49-d9c1-4650-894f-b4e4bffcdba9 req-449d4a0e-2a09-409f-b054-273042f3100e service nova] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2821ba49-d9c1-4650-894f-b4e4bffcdba9 req-449d4a0e-2a09-409f-b054-273042f3100e service nova] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:05 user nova-compute[75113]: DEBUG nova.compute.manager [req-2821ba49-d9c1-4650-894f-b4e4bffcdba9 req-449d4a0e-2a09-409f-b054-273042f3100e service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] No waiting events found dispatching network-vif-plugged-70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:28:05 user nova-compute[75113]: WARNING nova.compute.manager [req-2821ba49-d9c1-4650-894f-b4e4bffcdba9 req-449d4a0e-2a09-409f-b054-273042f3100e service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Received unexpected event network-vif-plugged-70be792f-4ef9-44c2-88ba-65d93df91382 for instance with vm_state building and task_state spawning.
Oct 26 17:28:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:28:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:28:05 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Instance spawned successfully.
Oct 26 17:28:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:28:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:28:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:28:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:28:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:28:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:28:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:28:05 user nova-compute[75113]: INFO nova.compute.manager [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Took 6.07 seconds to spawn the instance on the hypervisor.
Oct 26 17:28:05 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:28:05 user nova-compute[75113]: INFO nova.compute.manager [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Took 6.81 seconds to build instance.
Oct 26 17:28:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3ab1f5ef-bd46-4769-b394-0565cd561c44 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.921s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "600b26af-2d9d-4155-83fc-1393e8121c1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:28:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:12 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:28:12 user nova-compute[75113]: INFO nova.compute.claims [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Claim successful on node user
Oct 26 17:28:12 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:28:12 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:28:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:28:12 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:28:12 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:28:13 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:28:13 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG nova.policy [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b16af3affdf47f596f944cb83f772e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b425dca1e9645ad99fea4b666b01fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:28:13 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Creating image(s)
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "/opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "/opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "/opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.240s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.192s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Successfully created port: ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk 1073741824" returned: 0 in 0.076s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.202s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Checking if we can resize image /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:28:13 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Cannot resize image /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Ensure instance console log exists: /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Successfully updated port: ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquired lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-4d902ddd-e2a1-4ff8-8506-a03ffae14d90 req-c7b8fa98-b803-4097-ab6f-2041fcfc7b96 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-changed-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.compute.manager [req-4d902ddd-e2a1-4ff8-8506-a03ffae14d90 req-c7b8fa98-b803-4097-ab6f-2041fcfc7b96 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Refreshing instance network info cache due to event network-changed-ed39e3df-1326-462f-bbe4-18fdd101bab0. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4d902ddd-e2a1-4ff8-8506-a03ffae14d90 req-c7b8fa98-b803-4097-ab6f-2041fcfc7b96 service nova] Acquiring lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Updating instance_info_cache with network_info: [{"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Releasing lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Instance network_info: |[{"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4d902ddd-e2a1-4ff8-8506-a03ffae14d90 req-c7b8fa98-b803-4097-ab6f-2041fcfc7b96 service nova] Acquired lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.network.neutron [req-4d902ddd-e2a1-4ff8-8506-a03ffae14d90 req-c7b8fa98-b803-4097-ab6f-2041fcfc7b96 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Refreshing network info cache for port ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Start _get_guest_xml network_info=[{"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:28:14 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:28:14 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:28:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-734630711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-734630711',id=44,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBnU3iSIJrBhxGCzHoP9+OnC/LPQopOMDvVAXJ5j15sWMGjCODnHZYshasGGumTfYqhQ4KlICoR5C/Sh/MS0tAyB1Asc1Zngea5l3dj6Bk7KD1wQ1LDriDHlGPjQlZ+Bw==',key_name='tempest-keypair-2133541601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b425dca1e9645ad99fea4b666b01fab',ramdisk_id='',reservation_id='r-8q8iwxfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1688117037',owner_user_name='tempest-AttachVolumeShelveTestJSON-1688117037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:28:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b16af3affdf47f596f944cb83f772e9',uuid=600b26af-2d9d-4155-83fc-1393e8121c1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converting VIF {"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.objects.instance [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'pci_devices' on Instance uuid 600b26af-2d9d-4155-83fc-1393e8121c1c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:28:14 user nova-compute[75113]:   <uuid>600b26af-2d9d-4155-83fc-1393e8121c1c</uuid>
Oct 26 17:28:14 user nova-compute[75113]:   <name>instance-0000002c</name>
Oct 26 17:28:14 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:28:14 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:28:14 user nova-compute[75113]:   <metadata>
Oct 26 17:28:14 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:28:14 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:28:14 user nova-compute[75113]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-734630711</nova:name>
Oct 26 17:28:14 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:28:14</nova:creationTime>
Oct 26 17:28:14 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:28:14 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:28:14 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:28:14 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:28:14 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:28:14 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:28:14 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:28:14 user nova-compute[75113]:       <nova:owner>
Oct 26 17:28:14 user nova-compute[75113]:         <nova:user uuid="6b16af3affdf47f596f944cb83f772e9">tempest-AttachVolumeShelveTestJSON-1688117037-project-member</nova:user>
Oct 26 17:28:14 user nova-compute[75113]:         <nova:project uuid="2b425dca1e9645ad99fea4b666b01fab">tempest-AttachVolumeShelveTestJSON-1688117037</nova:project>
Oct 26 17:28:14 user nova-compute[75113]:       </nova:owner>
Oct 26 17:28:14 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:28:14 user nova-compute[75113]:       <nova:ports>
Oct 26 17:28:14 user nova-compute[75113]:         <nova:port uuid="ed39e3df-1326-462f-bbe4-18fdd101bab0">
Oct 26 17:28:14 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 17:28:14 user nova-compute[75113]:         </nova:port>
Oct 26 17:28:14 user nova-compute[75113]:       </nova:ports>
Oct 26 17:28:14 user nova-compute[75113]:     </nova:instance>
Oct 26 17:28:14 user nova-compute[75113]:   </metadata>
Oct 26 17:28:14 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:28:14 user nova-compute[75113]:     <system>
Oct 26 17:28:14 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:28:14 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:28:14 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:28:14 user nova-compute[75113]:       <entry name="serial">600b26af-2d9d-4155-83fc-1393e8121c1c</entry>
Oct 26 17:28:14 user nova-compute[75113]:       <entry name="uuid">600b26af-2d9d-4155-83fc-1393e8121c1c</entry>
Oct 26 17:28:14 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:28:14 user nova-compute[75113]:     </system>
Oct 26 17:28:14 user nova-compute[75113]:   </sysinfo>
Oct 26 17:28:14 user nova-compute[75113]:   <os>
Oct 26 17:28:14 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:28:14 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:28:14 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:28:14 user nova-compute[75113]:   </os>
Oct 26 17:28:14 user nova-compute[75113]:   <features>
Oct 26 17:28:14 user nova-compute[75113]:     <acpi/>
Oct 26 17:28:14 user nova-compute[75113]:     <apic/>
Oct 26 17:28:14 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:28:14 user nova-compute[75113]:   </features>
Oct 26 17:28:14 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:28:14 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:28:14 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:28:14 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:28:14 user nova-compute[75113]:   </clock>
Oct 26 17:28:14 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:28:14 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:28:14 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:28:14 user nova-compute[75113]:   </cpu>
Oct 26 17:28:14 user nova-compute[75113]:   <devices>
Oct 26 17:28:14 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:28:14 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:28:14 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk"/>
Oct 26 17:28:14 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:28:14 user nova-compute[75113]:     </disk>
Oct 26 17:28:14 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:28:14 user nova-compute[75113]:       <mac address="fa:16:3e:02:b4:b4"/>
Oct 26 17:28:14 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:28:14 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:28:14 user nova-compute[75113]:       <target dev="taped39e3df-13"/>
Oct 26 17:28:14 user nova-compute[75113]:     </interface>
Oct 26 17:28:14 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:28:14 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/console.log" append="off"/>
Oct 26 17:28:14 user nova-compute[75113]:     </serial>
Oct 26 17:28:14 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:28:14 user nova-compute[75113]:     <video>
Oct 26 17:28:14 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:28:14 user nova-compute[75113]:     </video>
Oct 26 17:28:14 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:28:14 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:28:14 user nova-compute[75113]:     </rng>
Oct 26 17:28:14 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:28:14 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:28:14 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:28:14 user nova-compute[75113]:     </memballoon>
Oct 26 17:28:14 user nova-compute[75113]:   </devices>
Oct 26 17:28:14 user nova-compute[75113]: </domain>
Oct 26 17:28:14 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:28:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-734630711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-734630711',id=44,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBnU3iSIJrBhxGCzHoP9+OnC/LPQopOMDvVAXJ5j15sWMGjCODnHZYshasGGumTfYqhQ4KlICoR5C/Sh/MS0tAyB1Asc1Zngea5l3dj6Bk7KD1wQ1LDriDHlGPjQlZ+Bw==',key_name='tempest-keypair-2133541601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b425dca1e9645ad99fea4b666b01fab',ramdisk_id='',reservation_id='r-8q8iwxfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1688117037',owner_user_name='tempest-AttachVolumeShelveTestJSON-1688117037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:28:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b16af3affdf47f596f944cb83f772e9',uuid=600b26af-2d9d-4155-83fc-1393e8121c1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converting VIF {"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG os_vif [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80d490d0-7d4d-5cba-96c6-8b16f52e214c', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped39e3df-13, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped39e3df-13, col_values=(('qos', UUID('09bdb4cb-7a0a-4709-a6bf-d9ce6244144c')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped39e3df-13, col_values=(('external_ids', {'iface-id': 'ed39e3df-1326-462f-bbe4-18fdd101bab0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:b4:b4', 'vm-uuid': '600b26af-2d9d-4155-83fc-1393e8121c1c'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:14 user nova-compute[75113]: INFO os_vif [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13')
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:28:14 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] No VIF found with MAC fa:16:3e:02:b4:b4, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:28:15 user nova-compute[75113]: DEBUG nova.network.neutron [req-4d902ddd-e2a1-4ff8-8506-a03ffae14d90 req-c7b8fa98-b803-4097-ab6f-2041fcfc7b96 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Updated VIF entry in instance network info cache for port ed39e3df-1326-462f-bbe4-18fdd101bab0. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:28:15 user nova-compute[75113]: DEBUG nova.network.neutron [req-4d902ddd-e2a1-4ff8-8506-a03ffae14d90 req-c7b8fa98-b803-4097-ab6f-2041fcfc7b96 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Updating instance_info_cache with network_info: [{"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:28:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4d902ddd-e2a1-4ff8-8506-a03ffae14d90 req-c7b8fa98-b803-4097-ab6f-2041fcfc7b96 service nova] Releasing lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:28:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-5747e2ba-4fa0-4edc-bc63-f9714aa183c5 req-65fc74c6-1af9-4050-9e9b-a6fd5e845efc service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:28:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5747e2ba-4fa0-4edc-bc63-f9714aa183c5 req-65fc74c6-1af9-4050-9e9b-a6fd5e845efc service nova] Acquiring lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5747e2ba-4fa0-4edc-bc63-f9714aa183c5 req-65fc74c6-1af9-4050-9e9b-a6fd5e845efc service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5747e2ba-4fa0-4edc-bc63-f9714aa183c5 req-65fc74c6-1af9-4050-9e9b-a6fd5e845efc service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-5747e2ba-4fa0-4edc-bc63-f9714aa183c5 req-65fc74c6-1af9-4050-9e9b-a6fd5e845efc service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] No waiting events found dispatching network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:28:16 user nova-compute[75113]: WARNING nova.compute.manager [req-5747e2ba-4fa0-4edc-bc63-f9714aa183c5 req-65fc74c6-1af9-4050-9e9b-a6fd5e845efc service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received unexpected event network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 for instance with vm_state building and task_state spawning.
Oct 26 17:28:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:28:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:28:18 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Instance spawned successfully.
Oct 26 17:28:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:28:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:28:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:28:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:28:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:28:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:28:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:28:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-af8a7ceb-95e6-4297-8ce3-da9f1a29f02e req-79e420e1-8287-40ff-8226-4701ce07e0d5 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:28:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af8a7ceb-95e6-4297-8ce3-da9f1a29f02e req-79e420e1-8287-40ff-8226-4701ce07e0d5 service nova] Acquiring lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af8a7ceb-95e6-4297-8ce3-da9f1a29f02e req-79e420e1-8287-40ff-8226-4701ce07e0d5 service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-af8a7ceb-95e6-4297-8ce3-da9f1a29f02e req-79e420e1-8287-40ff-8226-4701ce07e0d5 service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-af8a7ceb-95e6-4297-8ce3-da9f1a29f02e req-79e420e1-8287-40ff-8226-4701ce07e0d5 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] No waiting events found dispatching network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:28:18 user nova-compute[75113]: WARNING nova.compute.manager [req-af8a7ceb-95e6-4297-8ce3-da9f1a29f02e req-79e420e1-8287-40ff-8226-4701ce07e0d5 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received unexpected event network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 for instance with vm_state building and task_state spawning.
Oct 26 17:28:18 user nova-compute[75113]: INFO nova.compute.manager [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Took 5.29 seconds to spawn the instance on the hypervisor.
Oct 26 17:28:18 user nova-compute[75113]: DEBUG nova.compute.manager [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:28:18 user nova-compute[75113]: INFO nova.compute.manager [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Took 5.96 seconds to build instance.
Oct 26 17:28:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-7692fc12-def8-4a55-b417-d4c71d72f4b5 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.075s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:19 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:28:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:28:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-578398d8-2bfe-471f-b616-7b0bb5cc3a5d req-72f48bd2-e242-47d1-bc98-2fbf6956836e service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Received event network-changed-2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:28:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-578398d8-2bfe-471f-b616-7b0bb5cc3a5d req-72f48bd2-e242-47d1-bc98-2fbf6956836e service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Refreshing instance network info cache due to event network-changed-2cb265c0-d6bd-45df-8f3f-644e528b3649. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:28:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-578398d8-2bfe-471f-b616-7b0bb5cc3a5d req-72f48bd2-e242-47d1-bc98-2fbf6956836e service nova] Acquiring lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:28:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-578398d8-2bfe-471f-b616-7b0bb5cc3a5d req-72f48bd2-e242-47d1-bc98-2fbf6956836e service nova] Acquired lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:28:24 user nova-compute[75113]: DEBUG nova.network.neutron [req-578398d8-2bfe-471f-b616-7b0bb5cc3a5d req-72f48bd2-e242-47d1-bc98-2fbf6956836e service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Refreshing network info cache for port 2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:28:24 user nova-compute[75113]: DEBUG nova.network.neutron [req-578398d8-2bfe-471f-b616-7b0bb5cc3a5d req-72f48bd2-e242-47d1-bc98-2fbf6956836e service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updated VIF entry in instance network info cache for port 2cb265c0-d6bd-45df-8f3f-644e528b3649. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:28:24 user nova-compute[75113]: DEBUG nova.network.neutron [req-578398d8-2bfe-471f-b616-7b0bb5cc3a5d req-72f48bd2-e242-47d1-bc98-2fbf6956836e service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updating instance_info_cache with network_info: [{"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:28:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-578398d8-2bfe-471f-b616-7b0bb5cc3a5d req-72f48bd2-e242-47d1-bc98-2fbf6956836e service nova] Releasing lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:28:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:28:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:28 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:28:28 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:28:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG nova.objects.instance [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'flavor' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:28:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:31 user nova-compute[75113]: INFO nova.compute.manager [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Attaching volume bb0a84c6-971a-45c6-93cd-c573c4808710 to /dev/vdb
Oct 26 17:28:31 user nova-compute[75113]: DEBUG os_brick.utils [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d825c4a-37fd-4611-85cd-46fad2be8696]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63dee92-8432-4955-9e71-a4cb13cd9fd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cd55c2-dae4-4c9c-a566-8e3a653204ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[da02dbcc-16f7-4df8-a0cb-9f0493f8a832]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:28:31 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c83553f-c9e5-4a06-9307-21da63621c3e]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG os_brick.utils [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updating existing volume attachment record: 666574a3-4189-4ad4-a179-fad09c3d0173 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:32 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:28:32 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:28:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8206MB free_disk=25.03540802001953GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 97199d01-06b9-4e73-a23e-2b6110544afe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 3bde34c7-f234-4c16-b631-224c029ba6e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b1719df0-f4cc-4581-a823-5ba3bf388a05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 600b26af-2d9d-4155-83fc-1393e8121c1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:28:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:35 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:28:35 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:28:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:28:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:28:36 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:28:36 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updating instance_info_cache with network_info: [{"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:28:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:28:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:28:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:43 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:28:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKrBlQpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:28:50 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:28:50 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:28:50 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e342f78c-dc3a-4d89-8af1-d6b5256bc673]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:28:50 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ee8b5b-fcb7-42a5-8976-b7c50692afc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710] added
Oct 26 17:28:50 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[568b9d9b-8c8f-4edd-b38d-a0a6c7d80208]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fda3f32-9166-42c2-b3cc-90059d7b7ba9]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKrBlQpT {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKrBlQpT" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a798665d-8906-4942-9d59-075971c4f6d2]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fKrBlQpT'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2e2e51-a971-4654-b798-9255016e6f69]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d30830-7939-450a-a959-d4d862d1107c]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:28:50 user nova-compute[75113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:28:50 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:28:50 user nova-compute[75113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:28:50 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a26581-7853-44a4-8abe-313d6ee0520d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710, portal: 172.16.0.220,3260]
Oct 26 17:28:50 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710, portal: 172.16.0.220,3260] successful.
Oct 26 17:28:50 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0862a747-162f-4dc6-8f10-4ce893bd8a48]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[11246c96-9b57-40e0-9ff4-81fe7f1c84f2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:28:50 user nova-compute[75113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:28:50 user nova-compute[75113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 (non-flash)
Oct 26 17:28:50 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:28:50 user nova-compute[75113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:28:50 user nova-compute[75113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 (non-flash)
Oct 26 17:28:50 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2a7652-3748-4bb2-a0dd-ebb3ce32f426]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:28:50 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:28:51 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:28:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKrBlQpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:28:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:28:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26336663833393433', 'path': '/dev/sdd'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:28:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336663833393433', 'path': '/dev/sdd'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:28:51 user nova-compute[75113]: DEBUG nova.objects.instance [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'flavor' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:28:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:28:51 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:28:51 user nova-compute[75113]:   <source dev="/dev/sdd"/>
Oct 26 17:28:51 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:28:51 user nova-compute[75113]:   <serial>bb0a84c6-971a-45c6-93cd-c573c4808710</serial>
Oct 26 17:28:51 user nova-compute[75113]: </disk>
Oct 26 17:28:51 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:28:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:28:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:28:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:28:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No VIF found with MAC fa:16:3e:5f:9f:36, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:28:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-fa1db4bd-4371-4540-b02d-456289619a0a tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.295s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:28:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:28:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:28:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:28:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:28:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:28:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:28:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:29:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:29:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:29:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:29:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:29:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:29:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:29:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:29:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:29:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:29:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:20 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG nova.compute.manager [req-124bb78d-db49-4d8b-85e8-7d448c9d4aae req-ab9a3512-36e7-4bda-adb6-ab0cc2842180 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-changed-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG nova.compute.manager [req-124bb78d-db49-4d8b-85e8-7d448c9d4aae req-ab9a3512-36e7-4bda-adb6-ab0cc2842180 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Refreshing instance network info cache due to event network-changed-6af72c21-9dc2-4a66-b0fe-792b2ff617fe. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-124bb78d-db49-4d8b-85e8-7d448c9d4aae req-ab9a3512-36e7-4bda-adb6-ab0cc2842180 service nova] Acquiring lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-124bb78d-db49-4d8b-85e8-7d448c9d4aae req-ab9a3512-36e7-4bda-adb6-ab0cc2842180 service nova] Acquired lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG nova.network.neutron [req-124bb78d-db49-4d8b-85e8-7d448c9d4aae req-ab9a3512-36e7-4bda-adb6-ab0cc2842180 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Refreshing network info cache for port 6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "3bde34c7-f234-4c16-b631-224c029ba6e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:22 user nova-compute[75113]: INFO nova.compute.manager [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Terminating instance
Oct 26 17:29:22 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG nova.network.neutron [req-124bb78d-db49-4d8b-85e8-7d448c9d4aae req-ab9a3512-36e7-4bda-adb6-ab0cc2842180 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updated VIF entry in instance network info cache for port 6af72c21-9dc2-4a66-b0fe-792b2ff617fe. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG nova.network.neutron [req-124bb78d-db49-4d8b-85e8-7d448c9d4aae req-ab9a3512-36e7-4bda-adb6-ab0cc2842180 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating instance_info_cache with network_info: [{"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-124bb78d-db49-4d8b-85e8-7d448c9d4aae req-ab9a3512-36e7-4bda-adb6-ab0cc2842180 service nova] Releasing lock "refresh_cache-3bde34c7-f234-4c16-b631-224c029ba6e8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:29:23 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Instance destroyed successfully.
Oct 26 17:29:23 user nova-compute[75113]: DEBUG nova.objects.instance [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lazy-loading 'resources' on Instance uuid 3bde34c7-f234-4c16-b631-224c029ba6e8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:23:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1599500593',display_name='tempest-TestShelveInstance-server-1599500593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1599500593',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWVYz4AZfs9UYgwkwxK7OMuSZTVhnIn/EUPYm9pX6bRnq6gwN6QncrGykfiZNHRCcFcYVdnOMJQERLBZ6bzbFz5klneMgbu61zTsYgzkwt+J+lV920+/sRSLOz+P5SYPg==',key_name='tempest-TestShelveInstance-1332116264',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:27:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='309b039fa49c4e399504dcdcff86724e',ramdisk_id='',reservation_id='r-t2nawjxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1069964257',owner_user_name='tempest-TestShelveInstance-1069964257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:27:57Z,user_data=None,user_id='d5efe78e0cd34414853f640e4c850e5d',uuid=3bde34c7-f234-4c16-b631-224c029ba6e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Converting VIF {"id": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "address": "fa:16:3e:bf:82:80", "network": {"id": "f3962bf1-290c-40bc-97f6-a4a64af2615a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1705615832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "309b039fa49c4e399504dcdcff86724e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af72c21-9d", "ovs_interfaceid": "6af72c21-9dc2-4a66-b0fe-792b2ff617fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_vif [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6af72c21-9d, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e62c10e4-8378-4472-ac84-4811f2d0bb80) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:29:23 user nova-compute[75113]: INFO os_vif [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:82:80,bridge_name='br-int',has_traffic_filtering=True,id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe,network=Network(f3962bf1-290c-40bc-97f6-a4a64af2615a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af72c21-9d')
Oct 26 17:29:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXDzWLga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:29:23 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1822a4b-d914-4a45-bce4-107a44c3a621]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:530d9a4b-0668-43df-829b-b14af34b17dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a968710-e456-4073-b111-79d7c69f0f43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:29:23 user nova-compute[75113]: No targets found.
Oct 26 17:29:23 user nova-compute[75113]: iSNS:
Oct 26 17:29:23 user nova-compute[75113]: No targets found.
Oct 26 17:29:23 user nova-compute[75113]: STATIC:
Oct 26 17:29:23 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:530d9a4b-0668-43df-829b-b14af34b17dc
Oct 26 17:29:23 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:29:23 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:29:23 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e
Oct 26 17:29:23 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:29:23 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:29:23 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710
Oct 26 17:29:23 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:29:23 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:29:23 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad
Oct 26 17:29:23 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:29:23 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:29:23 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:1a968710-e456-4073-b111-79d7c69f0f43
Oct 26 17:29:23 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:29:23 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:29:23 user nova-compute[75113]: FIRMWARE:
Oct 26 17:29:23 user nova-compute[75113]: No targets found.
Oct 26 17:29:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:29:23 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:29:23 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9fdefa-d6c4-4d72-bb31-4e3f29bb4976]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a968710-e456-4073-b111-79d7c69f0f43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:530d9a4b-0668-43df-829b-b14af34b17dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6888adeb-49a0-4862-9841-111559bbf5c6]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a968710-e456-4073-b111-79d7c69f0f43 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d9a4b-0668-43df-829b-b14af34b17dc (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:29:23 user nova-compute[75113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:29:23 user nova-compute[75113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 (non-flash)
Oct 26 17:29:23 user nova-compute[75113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a968710-e456-4073-b111-79d7c69f0f43 (non-flash)
Oct 26 17:29:23 user nova-compute[75113]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d9a4b-0668-43df-829b-b14af34b17dc (non-flash)
Oct 26 17:29:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad (non-flash)
Oct 26 17:29:23 user nova-compute[75113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:29:23 user nova-compute[75113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 (non-flash)
Oct 26 17:29:23 user nova-compute[75113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a968710-e456-4073-b111-79d7c69f0f43 (non-flash)
Oct 26 17:29:23 user nova-compute[75113]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d9a4b-0668-43df-829b-b14af34b17dc (non-flash)
Oct 26 17:29:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4934d6e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ebbebd-4bd5-4454-8265-44536d97b41f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e267566-65ba-4c93-a761-f33e289926a8]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4c6ae4-47c9-4678-963f-5e88573ea09b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f2172a-39f3-454e-a532-fedce602d272]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7829bdbb-cefa-47ec-a510-9e1fa4c0f01c]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae42e96-732b-4ba1-a204-139cd15173fc]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260]
Oct 26 17:29:23 user nova-compute[75113]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad, portal: 172.16.0.220,3260] successful.
Oct 26 17:29:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aedb1cc-553c-461e-919f-f712e7e122ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c426d24-05c7-45bb-b1c6-5757ffb0d2d4]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] <== disconnect_volume: return (374ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:29:23 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Deleting instance files /opt/stack/data/nova/instances/3bde34c7-f234-4c16-b631-224c029ba6e8_del
Oct 26 17:29:23 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Deletion of /opt/stack/data/nova/instances/3bde34c7-f234-4c16-b631-224c029ba6e8_del complete
Oct 26 17:29:23 user nova-compute[75113]: INFO nova.compute.manager [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Took 1.43 seconds to destroy the instance on the hypervisor.
Oct 26 17:29:23 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:29:23 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:29:24 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:29:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-28791b93-8204-4547-b616-92aa5b975689 req-11910c53-3be8-4506-bc33-245ac4e73123 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-vif-unplugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:29:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-28791b93-8204-4547-b616-92aa5b975689 req-11910c53-3be8-4506-bc33-245ac4e73123 service nova] Acquiring lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-28791b93-8204-4547-b616-92aa5b975689 req-11910c53-3be8-4506-bc33-245ac4e73123 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-28791b93-8204-4547-b616-92aa5b975689 req-11910c53-3be8-4506-bc33-245ac4e73123 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-28791b93-8204-4547-b616-92aa5b975689 req-11910c53-3be8-4506-bc33-245ac4e73123 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] No waiting events found dispatching network-vif-unplugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:29:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-28791b93-8204-4547-b616-92aa5b975689 req-11910c53-3be8-4506-bc33-245ac4e73123 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-vif-unplugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:29:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-28791b93-8204-4547-b616-92aa5b975689 req-11910c53-3be8-4506-bc33-245ac4e73123 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:29:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-28791b93-8204-4547-b616-92aa5b975689 req-11910c53-3be8-4506-bc33-245ac4e73123 service nova] Acquiring lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-28791b93-8204-4547-b616-92aa5b975689 req-11910c53-3be8-4506-bc33-245ac4e73123 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-28791b93-8204-4547-b616-92aa5b975689 req-11910c53-3be8-4506-bc33-245ac4e73123 service nova] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-28791b93-8204-4547-b616-92aa5b975689 req-11910c53-3be8-4506-bc33-245ac4e73123 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] No waiting events found dispatching network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:29:24 user nova-compute[75113]: WARNING nova.compute.manager [req-28791b93-8204-4547-b616-92aa5b975689 req-11910c53-3be8-4506-bc33-245ac4e73123 service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received unexpected event network-vif-plugged-6af72c21-9dc2-4a66-b0fe-792b2ff617fe for instance with vm_state active and task_state deleting.
Oct 26 17:29:24 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Took 0.50 seconds to deallocate network for instance.
Oct 26 17:29:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-74500f0f-1207-4afd-86d2-75f5533ae027 req-ac7cc2ad-165c-44f2-81d4-2f3d330e684f service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Received event network-vif-deleted-6af72c21-9dc2-4a66-b0fe-792b2ff617fe {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:29:24 user nova-compute[75113]: INFO nova.compute.manager [req-74500f0f-1207-4afd-86d2-75f5533ae027 req-ac7cc2ad-165c-44f2-81d4-2f3d330e684f service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Neutron deleted interface 6af72c21-9dc2-4a66-b0fe-792b2ff617fe; detaching it from the instance and deleting it from the info cache
Oct 26 17:29:24 user nova-compute[75113]: DEBUG nova.network.neutron [req-74500f0f-1207-4afd-86d2-75f5533ae027 req-ac7cc2ad-165c-44f2-81d4-2f3d330e684f service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:29:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-74500f0f-1207-4afd-86d2-75f5533ae027 req-ac7cc2ad-165c-44f2-81d4-2f3d330e684f service nova] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Detach interface failed, port_id=6af72c21-9dc2-4a66-b0fe-792b2ff617fe, reason: Instance 3bde34c7-f234-4c16-b631-224c029ba6e8 could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:29:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:29:25 user nova-compute[75113]: INFO nova.compute.manager [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Took 1.25 seconds to detach 1 volumes for instance.
Oct 26 17:29:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] [instance: 3bde34c7-f234-4c16-b631-224c029ba6e8] Deleting volume: 9aedb1cc-553c-461e-919f-f712e7e122ad {{(pid=75113) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 17:29:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:26 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:29:26 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:29:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:26 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Deleted allocations for instance 3bde34c7-f234-4c16-b631-224c029ba6e8
Oct 26 17:29:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3c348280-158c-4adb-9832-440afe08d238 tempest-TestShelveInstance-1069964257 tempest-TestShelveInstance-1069964257-project-member] Lock "3bde34c7-f234-4c16-b631-224c029ba6e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.734s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:28 user nova-compute[75113]: INFO nova.compute.manager [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Detaching volume bb0a84c6-971a-45c6-93cd-c573c4808710
Oct 26 17:29:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:28 user nova-compute[75113]: INFO nova.virt.block_device [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Attempting to driver detach volume bb0a84c6-971a-45c6-93cd-c573c4808710 from mountpoint /dev/vdb
Oct 26 17:29:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Attempting to detach device vdb from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:29:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:29:28 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:29:28 user nova-compute[75113]:   <source dev="/dev/sdd"/>
Oct 26 17:29:28 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:29:28 user nova-compute[75113]:   <serial>bb0a84c6-971a-45c6-93cd-c573c4808710</serial>
Oct 26 17:29:28 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:29:28 user nova-compute[75113]: </disk>
Oct 26 17:29:28 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:29:28 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Successfully detached device vdb from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the persistent domain config.
Oct 26 17:29:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:29:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:29:28 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:29:28 user nova-compute[75113]:   <source dev="/dev/sdd"/>
Oct 26 17:29:28 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:29:28 user nova-compute[75113]:   <serial>bb0a84c6-971a-45c6-93cd-c573c4808710</serial>
Oct 26 17:29:28 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:29:28 user nova-compute[75113]: </disk>
Oct 26 17:29:28 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:29:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:29:29 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:29:30 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:29:31 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:29:31 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:29:32 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:29:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:29:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:29:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:29:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:34 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:29:34 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:29:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8414MB free_disk=25.00515365600586GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:29:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:29:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 97199d01-06b9-4e73-a23e-2b6110544afe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:29:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance b1719df0-f4cc-4581-a823-5ba3bf388a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:29:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 600b26af-2d9d-4155-83fc-1393e8121c1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:29:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:29:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:29:34 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:29:34 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:29:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:29:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:36 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:29:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:29:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:29:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:29:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:29:36 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:29:36 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:29:37 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Updating instance_info_cache with network_info: [{"id": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "address": "fa:16:3e:dd:45:07", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c529d-84", "ovs_interfaceid": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:29:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:29:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:29:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:45 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:29:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:49 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 97199d01-06b9-4e73-a23e-2b6110544afe is timed out.
Oct 26 17:29:49 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Successfully detached device vdb from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the live domain config.
Oct 26 17:29:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKrBlQpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:29:49 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[957a19d5-9ba9-4136-ba02-299a0da4d05e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:29:49 user nova-compute[75113]: No targets found.
Oct 26 17:29:49 user nova-compute[75113]: iSNS:
Oct 26 17:29:49 user nova-compute[75113]: No targets found.
Oct 26 17:29:49 user nova-compute[75113]: STATIC:
Oct 26 17:29:49 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e
Oct 26 17:29:49 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:29:49 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:29:49 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710
Oct 26 17:29:49 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:29:49 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:29:49 user nova-compute[75113]: FIRMWARE:
Oct 26 17:29:49 user nova-compute[75113]: No targets found.
Oct 26 17:29:49 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:29:49 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:29:49 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe75e0f-6a3e-4136-801c-e7bc677a345d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea52c238-2d7d-45e6-a854-3e0ba9ab0a66]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:29:49 user nova-compute[75113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 (non-flash)
Oct 26 17:29:49 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:29:49 user nova-compute[75113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 (non-flash)
Oct 26 17:29:49 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49143d9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710'): ({'sdd'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Removing single pathed devices sdd {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[35daf212-09d6-4996-872c-0278fcf6e335]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb94903e-ff7a-46a7-acb0-5dcae7ff9ab3]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Flushing IO for device /dev/sdd {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.011s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed12bbdf-3fbd-439d-acfa-a359bdbc7f23]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5465962c-d76c-4fe3-b207-89adf0b9293d]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] SCSI volumes sdd have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df9d16a-deaf-4320-b419-6978e9777461]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8156de-3d41-428c-b07b-f536fde33a74]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710, portal: 172.16.0.220,3260]
Oct 26 17:29:49 user nova-compute[75113]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710, portal: 172.16.0.220,3260] successful.
Oct 26 17:29:49 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0a84c6-971a-45c6-93cd-c573c4808710 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcbbbb1-bf76-49dc-8abb-a61020633fcd]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] <== disconnect_volume: return (284ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-fd40f52e-c8de-45ff-a278-3ebf7bf12b55 req-a7f71bc3-238c-44b4-967b-8f499a71936a service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Received event network-changed-70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-fd40f52e-c8de-45ff-a278-3ebf7bf12b55 req-a7f71bc3-238c-44b4-967b-8f499a71936a service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Refreshing instance network info cache due to event network-changed-70be792f-4ef9-44c2-88ba-65d93df91382. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fd40f52e-c8de-45ff-a278-3ebf7bf12b55 req-a7f71bc3-238c-44b4-967b-8f499a71936a service nova] Acquiring lock "refresh_cache-b1719df0-f4cc-4581-a823-5ba3bf388a05" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fd40f52e-c8de-45ff-a278-3ebf7bf12b55 req-a7f71bc3-238c-44b4-967b-8f499a71936a service nova] Acquired lock "refresh_cache-b1719df0-f4cc-4581-a823-5ba3bf388a05" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:29:49 user nova-compute[75113]: DEBUG nova.network.neutron [req-fd40f52e-c8de-45ff-a278-3ebf7bf12b55 req-a7f71bc3-238c-44b4-967b-8f499a71936a service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Refreshing network info cache for port 70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:29:50 user nova-compute[75113]: DEBUG nova.objects.instance [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'flavor' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:29:50 user nova-compute[75113]: DEBUG nova.network.neutron [req-fd40f52e-c8de-45ff-a278-3ebf7bf12b55 req-a7f71bc3-238c-44b4-967b-8f499a71936a service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Updated VIF entry in instance network info cache for port 70be792f-4ef9-44c2-88ba-65d93df91382. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:29:50 user nova-compute[75113]: DEBUG nova.network.neutron [req-fd40f52e-c8de-45ff-a278-3ebf7bf12b55 req-a7f71bc3-238c-44b4-967b-8f499a71936a service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Updating instance_info_cache with network_info: [{"id": "70be792f-4ef9-44c2-88ba-65d93df91382", "address": "fa:16:3e:76:41:7b", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70be792f-4e", "ovs_interfaceid": "70be792f-4ef9-44c2-88ba-65d93df91382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:29:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fd40f52e-c8de-45ff-a278-3ebf7bf12b55 req-a7f71bc3-238c-44b4-967b-8f499a71936a service nova] Releasing lock "refresh_cache-b1719df0-f4cc-4581-a823-5ba3bf388a05" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:29:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6c8f336f-5dc4-4f9a-80cd-9312cbb248b9 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.801s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "b1719df0-f4cc-4581-a823-5ba3bf388a05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:51 user nova-compute[75113]: INFO nova.compute.manager [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Terminating instance
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.compute.manager [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.imagecache [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Verify base images {{(pid=75113) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.imagecache [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Image id 91603055-2c31-464d-bb00-ae160ab6e467 yields fingerprint 6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 {{(pid=75113) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 17:29:51 user nova-compute[75113]: INFO nova.virt.libvirt.imagecache [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] image 91603055-2c31-464d-bb00-ae160ab6e467 at (/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0): checking
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.imagecache [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] image 91603055-2c31-464d-bb00-ae160ab6e467 at (/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0): image is in use {{(pid=75113) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.imagecache [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75113) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.imagecache [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] 600b26af-2d9d-4155-83fc-1393e8121c1c is a valid instance name {{(pid=75113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.imagecache [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] 600b26af-2d9d-4155-83fc-1393e8121c1c has a disk file {{(pid=75113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-1281d4d3-5447-4cd9-8d81-77550ab756b8 req-adbca11c-8a00-4027-bac5-e272a7a548b2 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Received event network-vif-unplugged-70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1281d4d3-5447-4cd9-8d81-77550ab756b8 req-adbca11c-8a00-4027-bac5-e272a7a548b2 service nova] Acquiring lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1281d4d3-5447-4cd9-8d81-77550ab756b8 req-adbca11c-8a00-4027-bac5-e272a7a548b2 service nova] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1281d4d3-5447-4cd9-8d81-77550ab756b8 req-adbca11c-8a00-4027-bac5-e272a7a548b2 service nova] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-1281d4d3-5447-4cd9-8d81-77550ab756b8 req-adbca11c-8a00-4027-bac5-e272a7a548b2 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] No waiting events found dispatching network-vif-unplugged-70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-1281d4d3-5447-4cd9-8d81-77550ab756b8 req-adbca11c-8a00-4027-bac5-e272a7a548b2 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Received event network-vif-unplugged-70be792f-4ef9-44c2-88ba-65d93df91382 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.imagecache [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 600b26af-2d9d-4155-83fc-1393e8121c1c is backed by 6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 {{(pid=75113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.imagecache [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] b1719df0-f4cc-4581-a823-5ba3bf388a05 is a valid instance name {{(pid=75113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.imagecache [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] b1719df0-f4cc-4581-a823-5ba3bf388a05 has a disk file {{(pid=75113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:29:51 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Instance destroyed successfully.
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.objects.instance [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'resources' on Instance uuid b1719df0-f4cc-4581-a823-5ba3bf388a05 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1689848409',display_name='tempest-AttachVolumeNegativeTest-server-1689848409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1689848409',id=43,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/yH2N8fn59zWGEkAipX93uN+5CjCHBvkRBTCrZPtjs30uTIucOhXMCkNkhVZQVka4f7vHc7jmWQS9yHlS+oOPznlv6EHb7Qc1DjfYA3b5kK/Y/tdFs8eXdVF0QxUlXrg==',key_name='tempest-keypair-1236807554',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:28:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c30bd0e84d1448158ca783491ed372f5',ramdisk_id='',reservation_id='r-jtvabckg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1111816565',owner_user_name='tempest-AttachVolumeNegativeTest-1111816565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:28:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47bb03390d7d489d91750653f399125f',uuid=b1719df0-f4cc-4581-a823-5ba3bf388a05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70be792f-4ef9-44c2-88ba-65d93df91382", "address": "fa:16:3e:76:41:7b", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70be792f-4e", "ovs_interfaceid": "70be792f-4ef9-44c2-88ba-65d93df91382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converting VIF {"id": "70be792f-4ef9-44c2-88ba-65d93df91382", "address": "fa:16:3e:76:41:7b", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70be792f-4e", "ovs_interfaceid": "70be792f-4ef9-44c2-88ba-65d93df91382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:41:7b,bridge_name='br-int',has_traffic_filtering=True,id=70be792f-4ef9-44c2-88ba-65d93df91382,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70be792f-4e') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG os_vif [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:41:7b,bridge_name='br-int',has_traffic_filtering=True,id=70be792f-4ef9-44c2-88ba-65d93df91382,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70be792f-4e') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70be792f-4e, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3073f7f2-11ea-470e-a79f-fc0d47750e58) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:29:51 user nova-compute[75113]: INFO os_vif [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:41:7b,bridge_name='br-int',has_traffic_filtering=True,id=70be792f-4ef9-44c2-88ba-65d93df91382,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70be792f-4e')
Oct 26 17:29:51 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Deleting instance files /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05_del
Oct 26 17:29:51 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Deletion of /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05_del complete
Oct 26 17:29:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json" returned: 1 in 0.253s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:29:52 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Error during ComputeManager._run_image_cache_manager_pass: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task Traceback (most recent call last):
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/privsep/qemu.py", line 109, in unprivileged_qemu_img_info
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task     out, err = processutils.execute(*cmd, prlimit=QEMU_IMG_LIMITS)
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task     raise ProcessExecutionError(exit_code=_returncode,
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task Command: /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk --force-share --output=json
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task Exit code: 1
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task Stdout: ''
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task Stderr: "qemu-img: Could not open '/opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk': Could not open '/opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk': No such file or directory\n"
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task 
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task 
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task Traceback (most recent call last):
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task     task(self, context)
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/compute/manager.py", line 11165, in _run_image_cache_manager_pass
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task     self.driver.manage_image_cache(context, filtered_instances)
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 11401, in manage_image_cache
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task     self.image_cache_manager.update(context, all_instances)
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/virt/libvirt/imagecache.py", line 387, in update
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task     self._age_and_verify_cached_images(context, all_instances, base_dir)
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/virt/libvirt/imagecache.py", line 326, in _age_and_verify_cached_images
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task     inuse_backing_images = self._list_backing_images()
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/virt/libvirt/imagecache.py", line 131, in _list_backing_images
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task     backing_file = libvirt_utils.get_disk_backing_file(
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/virt/libvirt/utils.py", line 252, in get_disk_backing_file
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task     backing_file = images.qemu_img_info(path, format).backing_file
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/virt/images.py", line 47, in qemu_img_info
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task     info = nova.privsep.qemu.unprivileged_qemu_img_info(path, format=format)
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/privsep/qemu.py", line 119, in unprivileged_qemu_img_info
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task     raise exception.DiskNotFound(location=path)
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/b1719df0-f4cc-4581-a823-5ba3bf388a05/disk
Oct 26 17:29:52 user nova-compute[75113]: ERROR oslo_service.periodic_task 
Oct 26 17:29:52 user nova-compute[75113]: INFO nova.compute.manager [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 26 17:29:52 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:29:52 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:29:52 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:29:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:29:53 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:29:53 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Took 1.01 seconds to deallocate network for instance.
Oct 26 17:29:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-b1378158-a1f5-4e15-8621-36355eb4d705 req-d5f9edc2-eb7d-4d7b-9f98-d2d50693c41e service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Received event network-vif-deleted-70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:29:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:53 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:29:53 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:29:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:53 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Deleted allocations for instance b1719df0-f4cc-4581-a823-5ba3bf388a05
Oct 26 17:29:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-09e9279e-4039-47d1-8098-9aaa80b6d854 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.428s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-1b1682a1-79ec-478b-a1f8-d64e7f4a1a3d req-2461ff65-f614-4fef-84fe-673657058441 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Received event network-vif-plugged-70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:29:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1b1682a1-79ec-478b-a1f8-d64e7f4a1a3d req-2461ff65-f614-4fef-84fe-673657058441 service nova] Acquiring lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:29:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1b1682a1-79ec-478b-a1f8-d64e7f4a1a3d req-2461ff65-f614-4fef-84fe-673657058441 service nova] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:29:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-1b1682a1-79ec-478b-a1f8-d64e7f4a1a3d req-2461ff65-f614-4fef-84fe-673657058441 service nova] Lock "b1719df0-f4cc-4581-a823-5ba3bf388a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:29:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-1b1682a1-79ec-478b-a1f8-d64e7f4a1a3d req-2461ff65-f614-4fef-84fe-673657058441 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] No waiting events found dispatching network-vif-plugged-70be792f-4ef9-44c2-88ba-65d93df91382 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:29:53 user nova-compute[75113]: WARNING nova.compute.manager [req-1b1682a1-79ec-478b-a1f8-d64e7f4a1a3d req-2461ff65-f614-4fef-84fe-673657058441 service nova] [instance: b1719df0-f4cc-4581-a823-5ba3bf388a05] Received unexpected event network-vif-plugged-70be792f-4ef9-44c2-88ba-65d93df91382 for instance with vm_state deleted and task_state None.
Oct 26 17:29:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:30:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:30:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:30:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:30:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-277b33a9-c29d-416a-bd5c-c1dc263ab219 req-6ef63627-2c36-4221-af7b-be1b81b954cf service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-changed-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:30:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-277b33a9-c29d-416a-bd5c-c1dc263ab219 req-6ef63627-2c36-4221-af7b-be1b81b954cf service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Refreshing instance network info cache due to event network-changed-ed39e3df-1326-462f-bbe4-18fdd101bab0. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:30:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-277b33a9-c29d-416a-bd5c-c1dc263ab219 req-6ef63627-2c36-4221-af7b-be1b81b954cf service nova] Acquiring lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:30:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-277b33a9-c29d-416a-bd5c-c1dc263ab219 req-6ef63627-2c36-4221-af7b-be1b81b954cf service nova] Acquired lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:30:03 user nova-compute[75113]: DEBUG nova.network.neutron [req-277b33a9-c29d-416a-bd5c-c1dc263ab219 req-6ef63627-2c36-4221-af7b-be1b81b954cf service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Refreshing network info cache for port ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:30:04 user nova-compute[75113]: DEBUG nova.network.neutron [req-277b33a9-c29d-416a-bd5c-c1dc263ab219 req-6ef63627-2c36-4221-af7b-be1b81b954cf service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Updated VIF entry in instance network info cache for port ed39e3df-1326-462f-bbe4-18fdd101bab0. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:30:04 user nova-compute[75113]: DEBUG nova.network.neutron [req-277b33a9-c29d-416a-bd5c-c1dc263ab219 req-6ef63627-2c36-4221-af7b-be1b81b954cf service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Updating instance_info_cache with network_info: [{"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:30:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-277b33a9-c29d-416a-bd5c-c1dc263ab219 req-6ef63627-2c36-4221-af7b-be1b81b954cf service nova] Releasing lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:30:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "600b26af-2d9d-4155-83fc-1393e8121c1c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:30:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:30:10 user nova-compute[75113]: INFO nova.compute.manager [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Shelving
Oct 26 17:30:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-36ac0493-d9a0-4f6f-a3f2-5d16301ae248 req-ad0f027e-4307-43db-8c94-60705f102f27 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-vif-unplugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:30:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-36ac0493-d9a0-4f6f-a3f2-5d16301ae248 req-ad0f027e-4307-43db-8c94-60705f102f27 service nova] Acquiring lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:30:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-36ac0493-d9a0-4f6f-a3f2-5d16301ae248 req-ad0f027e-4307-43db-8c94-60705f102f27 service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:30:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-36ac0493-d9a0-4f6f-a3f2-5d16301ae248 req-ad0f027e-4307-43db-8c94-60705f102f27 service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:30:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-36ac0493-d9a0-4f6f-a3f2-5d16301ae248 req-ad0f027e-4307-43db-8c94-60705f102f27 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] No waiting events found dispatching network-vif-unplugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:30:10 user nova-compute[75113]: WARNING nova.compute.manager [req-36ac0493-d9a0-4f6f-a3f2-5d16301ae248 req-ad0f027e-4307-43db-8c94-60705f102f27 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received unexpected event network-vif-unplugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 for instance with vm_state active and task_state shelving.
Oct 26 17:30:11 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Instance destroyed successfully.
Oct 26 17:30:11 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Beginning cold snapshot process
Oct 26 17:30:11 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 17:30:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk /opt/stack/data/nova/instances/snapshots/tmpoh33fa31/50d49373eae74a58b1ca8c5746b21dde {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:11 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk /opt/stack/data/nova/instances/snapshots/tmpoh33fa31/50d49373eae74a58b1ca8c5746b21dde" returned: 0 in 0.414s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:11 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Snapshot extracted, beginning image upload
Oct 26 17:30:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:12 user nova-compute[75113]: DEBUG nova.compute.manager [req-c1bca441-b473-4543-ae86-9371e603436f req-a38ddceb-f206-4b4a-a141-600678ad885d service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:30:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c1bca441-b473-4543-ae86-9371e603436f req-a38ddceb-f206-4b4a-a141-600678ad885d service nova] Acquiring lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:30:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c1bca441-b473-4543-ae86-9371e603436f req-a38ddceb-f206-4b4a-a141-600678ad885d service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:30:12 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-c1bca441-b473-4543-ae86-9371e603436f req-a38ddceb-f206-4b4a-a141-600678ad885d service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:30:12 user nova-compute[75113]: DEBUG nova.compute.manager [req-c1bca441-b473-4543-ae86-9371e603436f req-a38ddceb-f206-4b4a-a141-600678ad885d service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] No waiting events found dispatching network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:30:12 user nova-compute[75113]: WARNING nova.compute.manager [req-c1bca441-b473-4543-ae86-9371e603436f req-a38ddceb-f206-4b4a-a141-600678ad885d service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received unexpected event network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 17:30:14 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Snapshot image upload complete
Oct 26 17:30:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:30:14 user nova-compute[75113]: INFO nova.compute.manager [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Shelve offloading
Oct 26 17:30:14 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Instance destroyed successfully.
Oct 26 17:30:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:30:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:30:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquired lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:30:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG nova.network.neutron [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Updating instance_info_cache with network_info: [{"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Releasing lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:30:15 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Instance destroyed successfully.
Oct 26 17:30:15 user nova-compute[75113]: DEBUG nova.objects.instance [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'resources' on Instance uuid 600b26af-2d9d-4155-83fc-1393e8121c1c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:28:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-734630711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-734630711',id=44,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBnU3iSIJrBhxGCzHoP9+OnC/LPQopOMDvVAXJ5j15sWMGjCODnHZYshasGGumTfYqhQ4KlICoR5C/Sh/MS0tAyB1Asc1Zngea5l3dj6Bk7KD1wQ1LDriDHlGPjQlZ+Bw==',key_name='tempest-keypair-2133541601',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:28:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2b425dca1e9645ad99fea4b666b01fab',ramdisk_id='',reservation_id='r-8q8iwxfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1688117037',owner_user_name='tempest-AttachVolumeShelveTestJSON-1688117037-project-member',shelved_at='2023-10-26T17:30:14.511522',shelved_host='user',shelved_image_id='f884355c-8141-4bd7-93f5-d9b3742dfc8b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b16af3affdf47f596f944cb83f772e9',uuid=600b26af-2d9d-4155-83fc-1393e8121c1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converting VIF {"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG os_vif [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped39e3df-13, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG nova.compute.manager [req-16b10d62-a904-4847-852f-a6c1b9e417f2 req-b1766e93-1073-40ca-94bd-d3baf125ba54 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-changed-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG nova.compute.manager [req-16b10d62-a904-4847-852f-a6c1b9e417f2 req-b1766e93-1073-40ca-94bd-d3baf125ba54 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Refreshing instance network info cache due to event network-changed-ed39e3df-1326-462f-bbe4-18fdd101bab0. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-16b10d62-a904-4847-852f-a6c1b9e417f2 req-b1766e93-1073-40ca-94bd-d3baf125ba54 service nova] Acquiring lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-16b10d62-a904-4847-852f-a6c1b9e417f2 req-b1766e93-1073-40ca-94bd-d3baf125ba54 service nova] Acquired lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG nova.network.neutron [req-16b10d62-a904-4847-852f-a6c1b9e417f2 req-b1766e93-1073-40ca-94bd-d3baf125ba54 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Refreshing network info cache for port ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09bdb4cb-7a0a-4709-a6bf-d9ce6244144c) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:15 user nova-compute[75113]: INFO os_vif [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13')
Oct 26 17:30:15 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Deleting instance files /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c_del
Oct 26 17:30:15 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Deletion of /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c_del complete
Oct 26 17:30:15 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Deleted allocations for instance 600b26af-2d9d-4155-83fc-1393e8121c1c
Oct 26 17:30:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG nova.objects.instance [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'numa_topology' on Instance uuid 600b26af-2d9d-4155-83fc-1393e8121c1c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:30:15 user nova-compute[75113]: DEBUG nova.objects.base [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Object Instance<600b26af-2d9d-4155-83fc-1393e8121c1c> lazy-loaded attributes: resources,numa_topology {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:30:16 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:30:16 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:30:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:30:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-6529dd5a-d649-4794-a467-62c8c3fa8c4e tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.721s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:30:16 user nova-compute[75113]: DEBUG nova.network.neutron [req-16b10d62-a904-4847-852f-a6c1b9e417f2 req-b1766e93-1073-40ca-94bd-d3baf125ba54 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Updated VIF entry in instance network info cache for port ed39e3df-1326-462f-bbe4-18fdd101bab0. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:30:16 user nova-compute[75113]: DEBUG nova.network.neutron [req-16b10d62-a904-4847-852f-a6c1b9e417f2 req-b1766e93-1073-40ca-94bd-d3baf125ba54 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Updating instance_info_cache with network_info: [{"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "taped39e3df-13", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:30:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-16b10d62-a904-4847-852f-a6c1b9e417f2 req-b1766e93-1073-40ca-94bd-d3baf125ba54 service nova] Releasing lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:30:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:30:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:30:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:30:24 user nova-compute[75113]: DEBUG nova.objects.instance [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'flavor' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:30:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:30:25 user nova-compute[75113]: INFO nova.compute.manager [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Attaching volume 7740f5b5-6635-4045-a591-1d1afe082d72 to /dev/vdb
Oct 26 17:30:25 user nova-compute[75113]: DEBUG os_brick.utils [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe7985e-0013-43a4-ab45-3b8877bf048c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad2ecea-8546-40f4-a86b-59021f0529ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9052414-6f88-4459-8704-8443fab3a80f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[01645b17-c42a-4635-b49d-5098fab89b0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:30:25 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde3957b-832e-458b-ac70-dd3a38186327]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG os_brick.utils [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updating existing volume attachment record: 86bc2727-c80c-4110-9122-cf80294e7216 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:30:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:26 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:30:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:30 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:30:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:30:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:33 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:30:33 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:30:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.00113296508789GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:30:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:30:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:30:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:30:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 97199d01-06b9-4e73-a23e-2b6110544afe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:30:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:30:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:30:34 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:30:34 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:30:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:30:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:30:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:37 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:30:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:30:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:30:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:30:37 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:30:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:37 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updating instance_info_cache with network_info: [{"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:30:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:30:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:30:37 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:30:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:42 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:30:42 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 17:30:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:30:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:30:43 user nova-compute[75113]: INFO nova.compute.manager [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Detaching volume 8a2182c6-bdf0-4849-9399-88ef097f4a8e
Oct 26 17:30:43 user nova-compute[75113]: INFO nova.virt.block_device [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Attempting to driver detach volume 8a2182c6-bdf0-4849-9399-88ef097f4a8e from mountpoint /dev/vdb
Oct 26 17:30:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Attempting to detach device vdb from instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:30:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:30:43 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:30:43 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:30:43 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:30:43 user nova-compute[75113]:   <serial>8a2182c6-bdf0-4849-9399-88ef097f4a8e</serial>
Oct 26 17:30:43 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:30:43 user nova-compute[75113]: </disk>
Oct 26 17:30:43 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:30:43 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully detached device vdb from instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 from the persistent domain config.
Oct 26 17:30:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:30:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:30:43 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:30:43 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:30:43 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:30:43 user nova-compute[75113]:   <serial>8a2182c6-bdf0-4849-9399-88ef097f4a8e</serial>
Oct 26 17:30:43 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:30:43 user nova-compute[75113]: </disk>
Oct 26 17:30:43 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:30:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KyLwdBPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:30:44 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:30:44 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:30:44 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[303381a0-11f4-4982-ba6c-71a97410fe5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:30:44 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc62174-831f-4546-990b-4d7f9ecb1384]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72] added
Oct 26 17:30:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[729c5dc7-1c33-4536-8dec-f5d78a25650d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4824f8e6-bd3f-469d-9340-ee89462a7070]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KyLwdBPe {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KyLwdBPe" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[81573c8b-e2fb-440f-9bef-d0166301d0a4]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KyLwdBPe'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[16191327-6d14-408e-8fce-16c9161de637]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ab0076-c660-4fcb-9465-a9cadea953d2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:30:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:30:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da3399c-c785-4f7e-b19e-769cec1d8f7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72, portal: 172.16.0.220,3260]
Oct 26 17:30:44 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72, portal: 172.16.0.220,3260] successful.
Oct 26 17:30:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74c06b0-299a-4368-90f4-405bc50d29f6]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e46586-e319-4f14-92f1-3f73843e5117]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:30:44 user nova-compute[75113]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 (non-flash)
Oct 26 17:30:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:30:44 user nova-compute[75113]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 (non-flash)
Oct 26 17:30:44 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2ce238-432f-466e-8f28-172371836dc2]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:30:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:30:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:45 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:30:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KyLwdBPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:30:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:30:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23436326566396665', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:30:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436326566396665', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:30:45 user nova-compute[75113]: DEBUG nova.objects.instance [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'flavor' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:30:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:30:46 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:30:46 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:30:46 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:30:46 user nova-compute[75113]:   <serial>7740f5b5-6635-4045-a591-1d1afe082d72</serial>
Oct 26 17:30:46 user nova-compute[75113]: </disk>
Oct 26 17:30:46 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:30:46 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:30:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:30:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:30:46 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No VIF found with MAC fa:16:3e:5f:9f:36, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:30:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-b02107ea-4a05-4511-ba1e-357030901d0c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.571s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:30:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:49 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:30:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 17:30:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] There are 0 instances to clean {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 17:30:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:30:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:30:49 user nova-compute[75113]: INFO nova.compute.manager [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Detaching volume 7740f5b5-6635-4045-a591-1d1afe082d72
Oct 26 17:30:49 user nova-compute[75113]: INFO nova.virt.block_device [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Attempting to driver detach volume 7740f5b5-6635-4045-a591-1d1afe082d72 from mountpoint /dev/vdb
Oct 26 17:30:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Attempting to detach device vdb from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:30:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:30:49 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:30:49 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:30:49 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:30:49 user nova-compute[75113]:   <serial>7740f5b5-6635-4045-a591-1d1afe082d72</serial>
Oct 26 17:30:49 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:30:49 user nova-compute[75113]: </disk>
Oct 26 17:30:49 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:30:49 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Successfully detached device vdb from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the persistent domain config.
Oct 26 17:30:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:30:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:30:49 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:30:49 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:30:49 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:30:49 user nova-compute[75113]:   <serial>7740f5b5-6635-4045-a591-1d1afe082d72</serial>
Oct 26 17:30:49 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:30:49 user nova-compute[75113]: </disk>
Oct 26 17:30:49 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:30:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:30:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:30:55 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:30:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:00 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "d199214d-d2d4-4e03-b88a-756fcc1e9093" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:31:01 user nova-compute[75113]: INFO nova.compute.claims [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Claim successful on node user
Oct 26 17:31:01 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Refreshing inventories for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Updating ProviderTree inventory for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Updating inventory in ProviderTree for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Refreshing aggregate associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, aggregates: None {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Refreshing trait associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:31:01 user nova-compute[75113]: DEBUG nova.network.neutron [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:31:01 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:31:02 user nova-compute[75113]: DEBUG nova.compute.manager [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:31:02 user nova-compute[75113]: INFO nova.virt.block_device [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Booting with volume snapshot 63ebe928-c208-4fb3-bacc-1bd190a99a6f at /dev/vda
Oct 26 17:31:02 user nova-compute[75113]: DEBUG nova.policy [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81bf8ffc2a3746ad9f895d7c2118e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf93275d83e4eeeb9f8d1dc96d6e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:31:02 user nova-compute[75113]: DEBUG nova.network.neutron [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Successfully created port: 637a091d-e2d0-47ad-b108-6685bbc395e9 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:31:03 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 is timed out.
Oct 26 17:31:03 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully detached device vdb from instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 from the live domain config.
Oct 26 17:31:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoZOlNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:31:03 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG nova.network.neutron [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Successfully updated port: 637a091d-e2d0-47ad-b108-6685bbc395e9 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fdd333-99c8-44c1-a1a6-a33835b2a08d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:31:03 user nova-compute[75113]: No targets found.
Oct 26 17:31:03 user nova-compute[75113]: iSNS:
Oct 26 17:31:03 user nova-compute[75113]: No targets found.
Oct 26 17:31:03 user nova-compute[75113]: STATIC:
Oct 26 17:31:03 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e
Oct 26 17:31:03 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:31:03 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:31:03 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72
Oct 26 17:31:03 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:31:03 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:31:03 user nova-compute[75113]: FIRMWARE:
Oct 26 17:31:03 user nova-compute[75113]: No targets found.
Oct 26 17:31:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:31:03 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:31:03 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "refresh_cache-d199214d-d2d4-4e03-b88a-756fcc1e9093" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquired lock "refresh_cache-d199214d-d2d4-4e03-b88a-756fcc1e9093" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG nova.network.neutron [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b76be9d-4156-476c-baf7-72e93e7c49ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7408b72-bb36-4cba-b291-e880ac01749b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:31:03 user nova-compute[75113]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 (non-flash)
Oct 26 17:31:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e (non-flash)
Oct 26 17:31:03 user nova-compute[75113]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 (non-flash)
Oct 26 17:31:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f492c1aba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e'): ({'sdc'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Removing single pathed devices sdc {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG nova.network.neutron [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-9ccc9167-0891-4233-8828-c68abaeb9c9b req-294f24a3-c494-4ccb-af93-c789af3dc00a service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Received event network-changed-637a091d-e2d0-47ad-b108-6685bbc395e9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG nova.compute.manager [req-9ccc9167-0891-4233-8828-c68abaeb9c9b req-294f24a3-c494-4ccb-af93-c789af3dc00a service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Refreshing instance network info cache due to event network-changed-637a091d-e2d0-47ad-b108-6685bbc395e9. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9ccc9167-0891-4233-8828-c68abaeb9c9b req-294f24a3-c494-4ccb-af93-c789af3dc00a service nova] Acquiring lock "refresh_cache-d199214d-d2d4-4e03-b88a-756fcc1e9093" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9aae42-b2ad-46ea-9dd4-122348b93ed3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[547d85b8-ea93-4c0e-be13-2200fe15f191]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Flushing IO for device /dev/sdc {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f1451b-2004-4039-9b2f-f189a183f6cd]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[798e61b1-a3c6-4544-b1cb-4b61fa08603a]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e077f6-012b-478f-99e7-738404cb522c]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcaa7a6-8f17-427b-8842-7309b73cbddb]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e, portal: 172.16.0.220,3260]
Oct 26 17:31:03 user nova-compute[75113]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e, portal: 172.16.0.220,3260] successful.
Oct 26 17:31:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2182c6-bdf0-4849-9399-88ef097f4a8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[989816a3-b5d6-428e-b274-b4b656df03b2]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] <== disconnect_volume: return (308ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG nova.network.neutron [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Updating instance_info_cache with network_info: [{"id": "637a091d-e2d0-47ad-b108-6685bbc395e9", "address": "fa:16:3e:e6:93:46", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a091d-e2", "ovs_interfaceid": "637a091d-e2d0-47ad-b108-6685bbc395e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Releasing lock "refresh_cache-d199214d-d2d4-4e03-b88a-756fcc1e9093" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG nova.compute.manager [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Instance network_info: |[{"id": "637a091d-e2d0-47ad-b108-6685bbc395e9", "address": "fa:16:3e:e6:93:46", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a091d-e2", "ovs_interfaceid": "637a091d-e2d0-47ad-b108-6685bbc395e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9ccc9167-0891-4233-8828-c68abaeb9c9b req-294f24a3-c494-4ccb-af93-c789af3dc00a service nova] Acquired lock "refresh_cache-d199214d-d2d4-4e03-b88a-756fcc1e9093" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:31:03 user nova-compute[75113]: DEBUG nova.network.neutron [req-9ccc9167-0891-4233-8828-c68abaeb9c9b req-294f24a3-c494-4ccb-af93-c789af3dc00a service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Refreshing network info cache for port 637a091d-e2d0-47ad-b108-6685bbc395e9 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:31:04 user nova-compute[75113]: DEBUG nova.network.neutron [req-9ccc9167-0891-4233-8828-c68abaeb9c9b req-294f24a3-c494-4ccb-af93-c789af3dc00a service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Updated VIF entry in instance network info cache for port 637a091d-e2d0-47ad-b108-6685bbc395e9. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:31:04 user nova-compute[75113]: DEBUG nova.network.neutron [req-9ccc9167-0891-4233-8828-c68abaeb9c9b req-294f24a3-c494-4ccb-af93-c789af3dc00a service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Updating instance_info_cache with network_info: [{"id": "637a091d-e2d0-47ad-b108-6685bbc395e9", "address": "fa:16:3e:e6:93:46", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a091d-e2", "ovs_interfaceid": "637a091d-e2d0-47ad-b108-6685bbc395e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:31:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9ccc9167-0891-4233-8828-c68abaeb9c9b req-294f24a3-c494-4ccb-af93-c789af3dc00a service nova] Releasing lock "refresh_cache-d199214d-d2d4-4e03-b88a-756fcc1e9093" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:31:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'flavor' on Instance uuid 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:31:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-633e2208-34c0-4e1f-97de-b2ffd79cbdf9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.827s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG os_brick.utils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[debc9a55-03c5-47db-a111-a6242682b5ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ebcda0-a840-4d88-ab91-e41418dd9f39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[297de10b-e519-45c1-b7dd-c67250cd6155]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[23985948-b2de-41e2-a196-faca1a386a1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:31:07 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:31:07 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b21c3da-71be-4545-91bf-c3b6ddc801c3]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG os_brick.utils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:31:07 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Updating existing volume attachment record: e33e31aa-dca8-462f-8fc0-2ccff110a55d {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:31:10 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 97199d01-06b9-4e73-a23e-2b6110544afe is timed out.
Oct 26 17:31:10 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Successfully detached device vdb from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the live domain config.
Oct 26 17:31:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KyLwdBPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:31:10 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc138106-af9e-489c-a8e5-c9d778289149]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:31:10 user nova-compute[75113]: No targets found.
Oct 26 17:31:10 user nova-compute[75113]: iSNS:
Oct 26 17:31:10 user nova-compute[75113]: No targets found.
Oct 26 17:31:10 user nova-compute[75113]: STATIC:
Oct 26 17:31:10 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72
Oct 26 17:31:10 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:31:10 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:31:10 user nova-compute[75113]: FIRMWARE:
Oct 26 17:31:10 user nova-compute[75113]: No targets found.
Oct 26 17:31:10 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:31:10 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:31:10 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4300d803-791b-4287-a67e-dbe53aefc7fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d38c50-e383-4030-b337-bfefdf2212a8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 (non-flash)
Oct 26 17:31:10 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 (non-flash)
Oct 26 17:31:10 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914361900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d239b5-35fe-4ce9-83aa-1134e098b884]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8323dff3-d22a-4b5e-ac8b-68dcb74a250f]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[239e208f-f093-469e-8871-5ce465e0ffce]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dc36c1-3b9e-4eb2-95db-7ddf8687e92b]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc8208c-d4c7-4fc8-a418-90a3bee553d6]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d794cb3-ac3d-4995-a221-9ec900aadcee]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72, portal: 172.16.0.220,3260]
Oct 26 17:31:10 user nova-compute[75113]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72, portal: 172.16.0.220,3260] successful.
Oct 26 17:31:10 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7740f5b5-6635-4045-a591-1d1afe082d72 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[162041f2-29d5-4f8e-afed-e5e8c31dd577]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] <== disconnect_volume: return (281ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:31:10 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:11 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'flavor' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:31:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a9f9adc9-e323-4be7-bcfc-c92ae6a0bb68 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.738s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:31:20 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:21 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:31:22 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:31:22 user nova-compute[75113]: WARNING nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Oct 26 17:31:22 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:31:22 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:31:22 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid d199214d-d2d4-4e03-b88a-756fcc1e9093 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:31:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "d199214d-d2d4-4e03-b88a-756fcc1e9093" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:31:25 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Creating image(s)
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Ensure instance console log exists: /opt/stack/data/nova/instances/d199214d-d2d4-4e03-b88a-756fcc1e9093/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Start _get_guest_xml network_info=[{"id": "637a091d-e2d0-47ad-b108-6685bbc395e9", "address": "fa:16:3e:e6:93:46", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a091d-e2", "ovs_interfaceid": "637a091d-e2d0-47ad-b108-6685bbc395e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e33e31aa-dca8-462f-8fc0-2ccff110a55d', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjBwYUFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd199214d-d2d4-4e03-b88a-756fcc1e9093', 'attached_at': '', 'detached_at': '', 'volume_id': '59220498-b88c-4c8a-b5cc-2b4191bd636a', 'serial': '59220498-b88c-4c8a-b5cc-2b4191bd636a'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:31:25 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:31:25 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjBwYUFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:31:25 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:31:25 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:31:25 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4b65f7-4f8b-4683-b379-9441a23d551e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:31:25 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f78cc1e-36b2-49a8-9450-6da1793b8a11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a] added
Oct 26 17:31:25 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f168196-036d-46bc-8c43-5a2e288a99d3]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaf0965-dcc7-4ce1-aa05-c4b66fa6418b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjBwYUFC {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjBwYUFC" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[266117f6-4ab5-4c01-a711-ad6d208f5dc1]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pjBwYUFC'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a336c4d-84a2-4a4b-af23-54cf664c2512]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadbd32c-772d-45e3-8b15-8a74d52bd58d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:31:25 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:31:25 user nova-compute[75113]:  {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:31:25 user nova-compute[75113]: WARNING os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 17:31:25 user nova-compute[75113]: 
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[666c7932-ac8e-4af6-8960-abe993c80b05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a, portal: 172.16.0.220,3260]
Oct 26 17:31:25 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a, portal: 172.16.0.220,3260] successful.
Oct 26 17:31:25 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8522015-5336-432e-94ed-2de8e7d3a9b1]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[903b5fc9-d304-42bc-8f86-e80d87eb8520]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)
Oct 26 17:31:25 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)
Oct 26 17:31:25 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[613b5400-7c25-4bc1-943a-2f2ea9042f75]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:31:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjBwYUFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== connect_volume: return (1266ms) {'type': 'block', 'scsi_wwn': '26535663364303335', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535663364303335', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1531694038',display_name='tempest-TestVolumeBootPattern-server-1531694038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1531694038',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-egnw8etv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:31:02Z,user_data=None,user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=d199214d-d2d4-4e03-b88a-756fcc1e9093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "637a091d-e2d0-47ad-b108-6685bbc395e9", "address": "fa:16:3e:e6:93:46", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a091d-e2", "ovs_interfaceid": "637a091d-e2d0-47ad-b108-6685bbc395e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "637a091d-e2d0-47ad-b108-6685bbc395e9", "address": "fa:16:3e:e6:93:46", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a091d-e2", "ovs_interfaceid": "637a091d-e2d0-47ad-b108-6685bbc395e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:46,bridge_name='br-int',has_traffic_filtering=True,id=637a091d-e2d0-47ad-b108-6685bbc395e9,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a091d-e2') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG nova.objects.instance [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lazy-loading 'pci_devices' on Instance uuid d199214d-d2d4-4e03-b88a-756fcc1e9093 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:31:26 user nova-compute[75113]:   <uuid>d199214d-d2d4-4e03-b88a-756fcc1e9093</uuid>
Oct 26 17:31:26 user nova-compute[75113]:   <name>instance-0000002d</name>
Oct 26 17:31:26 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:31:26 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:31:26 user nova-compute[75113]:   <metadata>
Oct 26 17:31:26 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:31:26 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:31:26 user nova-compute[75113]:       <nova:name>tempest-TestVolumeBootPattern-server-1531694038</nova:name>
Oct 26 17:31:26 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:31:25</nova:creationTime>
Oct 26 17:31:26 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:31:26 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:31:26 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:31:26 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:31:26 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:31:26 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:31:26 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:31:26 user nova-compute[75113]:       <nova:owner>
Oct 26 17:31:26 user nova-compute[75113]:         <nova:user uuid="81bf8ffc2a3746ad9f895d7c2118e33a">tempest-TestVolumeBootPattern-27660292-project-member</nova:user>
Oct 26 17:31:26 user nova-compute[75113]:         <nova:project uuid="9bf93275d83e4eeeb9f8d1dc96d6e7f8">tempest-TestVolumeBootPattern-27660292</nova:project>
Oct 26 17:31:26 user nova-compute[75113]:       </nova:owner>
Oct 26 17:31:26 user nova-compute[75113]:       <nova:ports>
Oct 26 17:31:26 user nova-compute[75113]:         <nova:port uuid="637a091d-e2d0-47ad-b108-6685bbc395e9">
Oct 26 17:31:26 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 17:31:26 user nova-compute[75113]:         </nova:port>
Oct 26 17:31:26 user nova-compute[75113]:       </nova:ports>
Oct 26 17:31:26 user nova-compute[75113]:     </nova:instance>
Oct 26 17:31:26 user nova-compute[75113]:   </metadata>
Oct 26 17:31:26 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:31:26 user nova-compute[75113]:     <system>
Oct 26 17:31:26 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:31:26 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:31:26 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:31:26 user nova-compute[75113]:       <entry name="serial">d199214d-d2d4-4e03-b88a-756fcc1e9093</entry>
Oct 26 17:31:26 user nova-compute[75113]:       <entry name="uuid">d199214d-d2d4-4e03-b88a-756fcc1e9093</entry>
Oct 26 17:31:26 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:31:26 user nova-compute[75113]:     </system>
Oct 26 17:31:26 user nova-compute[75113]:   </sysinfo>
Oct 26 17:31:26 user nova-compute[75113]:   <os>
Oct 26 17:31:26 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:31:26 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:31:26 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:31:26 user nova-compute[75113]:   </os>
Oct 26 17:31:26 user nova-compute[75113]:   <features>
Oct 26 17:31:26 user nova-compute[75113]:     <acpi/>
Oct 26 17:31:26 user nova-compute[75113]:     <apic/>
Oct 26 17:31:26 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:31:26 user nova-compute[75113]:   </features>
Oct 26 17:31:26 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:31:26 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:31:26 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:31:26 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:31:26 user nova-compute[75113]:   </clock>
Oct 26 17:31:26 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:31:26 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:31:26 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:31:26 user nova-compute[75113]:   </cpu>
Oct 26 17:31:26 user nova-compute[75113]:   <devices>
Oct 26 17:31:26 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:31:26 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:31:26 user nova-compute[75113]:       <source dev="/dev/sdb"/>
Oct 26 17:31:26 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:31:26 user nova-compute[75113]:       <serial>59220498-b88c-4c8a-b5cc-2b4191bd636a</serial>
Oct 26 17:31:26 user nova-compute[75113]:     </disk>
Oct 26 17:31:26 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:31:26 user nova-compute[75113]:       <mac address="fa:16:3e:e6:93:46"/>
Oct 26 17:31:26 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:31:26 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:31:26 user nova-compute[75113]:       <target dev="tap637a091d-e2"/>
Oct 26 17:31:26 user nova-compute[75113]:     </interface>
Oct 26 17:31:26 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:31:26 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/d199214d-d2d4-4e03-b88a-756fcc1e9093/console.log" append="off"/>
Oct 26 17:31:26 user nova-compute[75113]:     </serial>
Oct 26 17:31:26 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:31:26 user nova-compute[75113]:     <video>
Oct 26 17:31:26 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:31:26 user nova-compute[75113]:     </video>
Oct 26 17:31:26 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:31:26 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:31:26 user nova-compute[75113]:     </rng>
Oct 26 17:31:26 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:31:26 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:31:26 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:31:26 user nova-compute[75113]:     </memballoon>
Oct 26 17:31:26 user nova-compute[75113]:   </devices>
Oct 26 17:31:26 user nova-compute[75113]: </domain>
Oct 26 17:31:26 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1531694038',display_name='tempest-TestVolumeBootPattern-server-1531694038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1531694038',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-egnw8etv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:31:02Z,user_data=None,user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=d199214d-d2d4-4e03-b88a-756fcc1e9093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "637a091d-e2d0-47ad-b108-6685bbc395e9", "address": "fa:16:3e:e6:93:46", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a091d-e2", "ovs_interfaceid": "637a091d-e2d0-47ad-b108-6685bbc395e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "637a091d-e2d0-47ad-b108-6685bbc395e9", "address": "fa:16:3e:e6:93:46", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a091d-e2", "ovs_interfaceid": "637a091d-e2d0-47ad-b108-6685bbc395e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:46,bridge_name='br-int',has_traffic_filtering=True,id=637a091d-e2d0-47ad-b108-6685bbc395e9,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a091d-e2') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG os_vif [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:46,bridge_name='br-int',has_traffic_filtering=True,id=637a091d-e2d0-47ad-b108-6685bbc395e9,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a091d-e2') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40cd9f0d-cdbf-52d2-83f3-a12cbd43aa53', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap637a091d-e2, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap637a091d-e2, col_values=(('qos', UUID('d3a73e4c-a3a8-423e-9493-1ac27ca4a0cf')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap637a091d-e2, col_values=(('external_ids', {'iface-id': '637a091d-e2d0-47ad-b108-6685bbc395e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:93:46', 'vm-uuid': 'd199214d-d2d4-4e03-b88a-756fcc1e9093'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:31:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:26 user nova-compute[75113]: INFO os_vif [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:46,bridge_name='br-int',has_traffic_filtering=True,id=637a091d-e2d0-47ad-b108-6685bbc395e9,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a091d-e2')
Oct 26 17:31:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:31:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] No VIF found with MAC fa:16:3e:e6:93:46, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:31:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-6cefc431-58d5-4315-af66-6d2c3777e673 req-6b812e3b-b4cb-490f-90a4-813fe0d45564 service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Received event network-vif-plugged-637a091d-e2d0-47ad-b108-6685bbc395e9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:31:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6cefc431-58d5-4315-af66-6d2c3777e673 req-6b812e3b-b4cb-490f-90a4-813fe0d45564 service nova] Acquiring lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6cefc431-58d5-4315-af66-6d2c3777e673 req-6b812e3b-b4cb-490f-90a4-813fe0d45564 service nova] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6cefc431-58d5-4315-af66-6d2c3777e673 req-6b812e3b-b4cb-490f-90a4-813fe0d45564 service nova] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-6cefc431-58d5-4315-af66-6d2c3777e673 req-6b812e3b-b4cb-490f-90a4-813fe0d45564 service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] No waiting events found dispatching network-vif-plugged-637a091d-e2d0-47ad-b108-6685bbc395e9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:31:28 user nova-compute[75113]: WARNING nova.compute.manager [req-6cefc431-58d5-4315-af66-6d2c3777e673 req-6b812e3b-b4cb-490f-90a4-813fe0d45564 service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Received unexpected event network-vif-plugged-637a091d-e2d0-47ad-b108-6685bbc395e9 for instance with vm_state building and task_state spawning.
Oct 26 17:31:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG nova.compute.manager [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:31:30 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Instance spawned successfully.
Oct 26 17:31:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:31:30 user nova-compute[75113]: INFO nova.compute.manager [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Took 4.80 seconds to spawn the instance on the hypervisor.
Oct 26 17:31:30 user nova-compute[75113]: DEBUG nova.compute.manager [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-d91d49a0-d405-4498-a46f-2f238d39261e req-34cc157b-66e9-4a27-ae6e-e46d430058cf service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Received event network-vif-plugged-637a091d-e2d0-47ad-b108-6685bbc395e9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d91d49a0-d405-4498-a46f-2f238d39261e req-34cc157b-66e9-4a27-ae6e-e46d430058cf service nova] Acquiring lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d91d49a0-d405-4498-a46f-2f238d39261e req-34cc157b-66e9-4a27-ae6e-e46d430058cf service nova] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d91d49a0-d405-4498-a46f-2f238d39261e req-34cc157b-66e9-4a27-ae6e-e46d430058cf service nova] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-d91d49a0-d405-4498-a46f-2f238d39261e req-34cc157b-66e9-4a27-ae6e-e46d430058cf service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] No waiting events found dispatching network-vif-plugged-637a091d-e2d0-47ad-b108-6685bbc395e9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:31:30 user nova-compute[75113]: WARNING nova.compute.manager [req-d91d49a0-d405-4498-a46f-2f238d39261e req-34cc157b-66e9-4a27-ae6e-e46d430058cf service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Received unexpected event network-vif-plugged-637a091d-e2d0-47ad-b108-6685bbc395e9 for instance with vm_state building and task_state spawning.
Oct 26 17:31:30 user nova-compute[75113]: INFO nova.compute.manager [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Took 28.88 seconds to build instance.
Oct 26 17:31:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-124d7fe5-645a-4e21-98e9-ab32f60bd297 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.973s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.631s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:30 user nova-compute[75113]: INFO nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 26 17:31:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:31 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:31:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:33 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:31:33 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:31:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8654MB free_disk=24.998310089111328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:33 user nova-compute[75113]: INFO nova.compute.manager [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Terminating instance
Oct 26 17:31:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 97199d01-06b9-4e73-a23e-2b6110544afe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance d199214d-d2d4-4e03-b88a-756fcc1e9093 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-875f5f06-8214-45f1-be76-f649eee5520e req-883943f4-a894-421d-a1d1-1ee32b54903d service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Received event network-vif-unplugged-2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-875f5f06-8214-45f1-be76-f649eee5520e req-883943f4-a894-421d-a1d1-1ee32b54903d service nova] Acquiring lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-875f5f06-8214-45f1-be76-f649eee5520e req-883943f4-a894-421d-a1d1-1ee32b54903d service nova] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-875f5f06-8214-45f1-be76-f649eee5520e req-883943f4-a894-421d-a1d1-1ee32b54903d service nova] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-875f5f06-8214-45f1-be76-f649eee5520e req-883943f4-a894-421d-a1d1-1ee32b54903d service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] No waiting events found dispatching network-vif-unplugged-2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG nova.compute.manager [req-875f5f06-8214-45f1-be76-f649eee5520e req-883943f4-a894-421d-a1d1-1ee32b54903d service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Received event network-vif-unplugged-2e7c529d-8456-49e4-be69-66b8b4f86d00 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:31:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:34 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Instance destroyed successfully.
Oct 26 17:31:34 user nova-compute[75113]: DEBUG nova.objects.instance [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'resources' on Instance uuid 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:25:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1485832923',display_name='tempest-AttachVolumeNegativeTest-server-1485832923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1485832923',id=41,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZdROu/DGyoXThU0i9TihXUoo0/D7NZfVSjRaFI3teE5AkGS4C42odDd7Nv9lFubaghYH2GJKkuHAgYRI93wIwLMy8X4swARqq6t9f+nMtU+kRk+o7dcb7MK6sJ2SDA+g==',key_name='tempest-keypair-1633032287',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:25:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c30bd0e84d1448158ca783491ed372f5',ramdisk_id='',reservation_id='r-8w6cdl1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1111816565',owner_user_name='tempest-AttachVolumeNegativeTest-1111816565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47bb03390d7d489d91750653f399125f',uuid=2bfe78d7-34e4-4cdb-bbb2-3ae460a16610,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "address": "fa:16:3e:dd:45:07", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c529d-84", "ovs_interfaceid": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converting VIF {"id": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "address": "fa:16:3e:dd:45:07", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c529d-84", "ovs_interfaceid": "2e7c529d-8456-49e4-be69-66b8b4f86d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:45:07,bridge_name='br-int',has_traffic_filtering=True,id=2e7c529d-8456-49e4-be69-66b8b4f86d00,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c529d-84') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG os_vif [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:45:07,bridge_name='br-int',has_traffic_filtering=True,id=2e7c529d-8456-49e4-be69-66b8b4f86d00,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c529d-84') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e7c529d-84, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0db1be39-7555-4f82-869a-d128b48ca165) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:31:34 user nova-compute[75113]: INFO os_vif [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:45:07,bridge_name='br-int',has_traffic_filtering=True,id=2e7c529d-8456-49e4-be69-66b8b4f86d00,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c529d-84')
Oct 26 17:31:34 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Deleting instance files /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610_del
Oct 26 17:31:34 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Deletion of /opt/stack/data/nova/instances/2bfe78d7-34e4-4cdb-bbb2-3ae460a16610_del complete
Oct 26 17:31:34 user nova-compute[75113]: INFO nova.compute.manager [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 26 17:31:34 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:31:34 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG nova.compute.manager [req-2c278559-afb7-471d-833f-bfa0bb84a0b0 req-2e12a411-e278-4f67-8a17-fce8f273ef5e service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Received event network-vif-deleted-2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:31:35 user nova-compute[75113]: INFO nova.compute.manager [req-2c278559-afb7-471d-833f-bfa0bb84a0b0 req-2e12a411-e278-4f67-8a17-fce8f273ef5e service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Neutron deleted interface 2e7c529d-8456-49e4-be69-66b8b4f86d00; detaching it from the instance and deleting it from the info cache
Oct 26 17:31:35 user nova-compute[75113]: DEBUG nova.network.neutron [req-2c278559-afb7-471d-833f-bfa0bb84a0b0 req-2e12a411-e278-4f67-8a17-fce8f273ef5e service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:31:35 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Took 0.97 seconds to deallocate network for instance.
Oct 26 17:31:35 user nova-compute[75113]: DEBUG nova.compute.manager [req-2c278559-afb7-471d-833f-bfa0bb84a0b0 req-2e12a411-e278-4f67-8a17-fce8f273ef5e service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Detach interface failed, port_id=2e7c529d-8456-49e4-be69-66b8b4f86d00, reason: Instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610 could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:35 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Deleted allocations for instance 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610
Oct 26 17:31:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-059f1b50-6b91-4091-bc43-f2316d2a6976 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.180s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG nova.compute.manager [req-28f486ae-ad18-4ec1-b82a-b0e56f45a369 req-83a16562-a155-4816-a0aa-d008a2377d43 service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Received event network-vif-plugged-2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-28f486ae-ad18-4ec1-b82a-b0e56f45a369 req-83a16562-a155-4816-a0aa-d008a2377d43 service nova] Acquiring lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-28f486ae-ad18-4ec1-b82a-b0e56f45a369 req-83a16562-a155-4816-a0aa-d008a2377d43 service nova] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-28f486ae-ad18-4ec1-b82a-b0e56f45a369 req-83a16562-a155-4816-a0aa-d008a2377d43 service nova] Lock "2bfe78d7-34e4-4cdb-bbb2-3ae460a16610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG nova.compute.manager [req-28f486ae-ad18-4ec1-b82a-b0e56f45a369 req-83a16562-a155-4816-a0aa-d008a2377d43 service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] No waiting events found dispatching network-vif-plugged-2e7c529d-8456-49e4-be69-66b8b4f86d00 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:31:35 user nova-compute[75113]: WARNING nova.compute.manager [req-28f486ae-ad18-4ec1-b82a-b0e56f45a369 req-83a16562-a155-4816-a0aa-d008a2377d43 service nova] [instance: 2bfe78d7-34e4-4cdb-bbb2-3ae460a16610] Received unexpected event network-vif-plugged-2e7c529d-8456-49e4-be69-66b8b4f86d00 for instance with vm_state deleted and task_state None.
Oct 26 17:31:35 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:31:35 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:31:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG nova.objects.instance [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'flavor' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:31:46 user nova-compute[75113]: INFO nova.compute.manager [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Attaching volume a2691f21-61f2-4c01-9f4e-b097ccf299f1 to /dev/vdb
Oct 26 17:31:46 user nova-compute[75113]: DEBUG os_brick.utils [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda46995-b56a-4475-9725-3752d5dc6778]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5731276b-dea6-4246-82b8-d14f794db0f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c873ad3-02e2-4b7c-a72b-81d2dbe02b73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d67430-7eb0-4c2f-8872-4e6d73c37bb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:31:46 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:31:46 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ba42de-5de0-47d8-b27e-31c4ddd2b967]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG os_brick.utils [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:31:46 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updating existing volume attachment record: 34f8a8c3-05a2-4c17-a42b-3cc48c06e2f7 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:31:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:31:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "600b26af-2d9d-4155-83fc-1393e8121c1c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:03 user nova-compute[75113]: INFO nova.compute.manager [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Unshelving
Oct 26 17:32:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:03 user nova-compute[75113]: DEBUG nova.objects.instance [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'pci_requests' on Instance uuid 600b26af-2d9d-4155-83fc-1393e8121c1c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:32:03 user nova-compute[75113]: DEBUG nova.objects.instance [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'numa_topology' on Instance uuid 600b26af-2d9d-4155-83fc-1393e8121c1c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:32:03 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:32:03 user nova-compute[75113]: INFO nova.compute.claims [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Claim successful on node user
Oct 26 17:32:03 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:32:03 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:32:03 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:03 user nova-compute[75113]: INFO nova.network.neutron [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Updating port ed39e3df-1326-462f-bbe4-18fdd101bab0 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquired lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG nova.network.neutron [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-01af8b33-88af-4fc5-ad64-e401d1a6a1f2 req-2fcaf5c7-cfe7-46ba-a9e6-162f23649ea7 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-changed-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-01af8b33-88af-4fc5-ad64-e401d1a6a1f2 req-2fcaf5c7-cfe7-46ba-a9e6-162f23649ea7 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Refreshing instance network info cache due to event network-changed-ed39e3df-1326-462f-bbe4-18fdd101bab0. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-01af8b33-88af-4fc5-ad64-e401d1a6a1f2 req-2fcaf5c7-cfe7-46ba-a9e6-162f23649ea7 service nova] Acquiring lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG nova.network.neutron [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Updating instance_info_cache with network_info: [{"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Releasing lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:32:04 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Creating image(s)
Oct 26 17:32:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "/opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "/opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "/opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'trusted_certs' on Instance uuid 600b26af-2d9d-4155-83fc-1393e8121c1c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-01af8b33-88af-4fc5-ad64-e401d1a6a1f2 req-2fcaf5c7-cfe7-46ba-a9e6-162f23649ea7 service nova] Acquired lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG nova.network.neutron [req-01af8b33-88af-4fc5-ad64-e401d1a6a1f2 req-2fcaf5c7-cfe7-46ba-a9e6-162f23649ea7 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Refreshing network info cache for port ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG nova.objects.base [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Object Instance<600b26af-2d9d-4155-83fc-1393e8121c1c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "436792927af9717d1ad956c82b1b9f0d18a7aca2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "436792927af9717d1ad956c82b1b9f0d18a7aca2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2.part --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUOrsNaH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:32:05 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:32:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:32:05 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:32:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:32:05 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fbb5b1-1779-4761-a613-676d806cf509]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:32:05 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6981c445-44ed-46d2-83b6-3a101533c13a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1] added
Oct 26 17:32:05 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f889f388-1a5d-4317-8d30-48569632d2f9]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1574b2-2396-4e54-a292-169fb434563b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUOrsNaH {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2.part --force-share --output=json" returned: 0 in 0.211s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG nova.virt.images [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] f884355c-8141-4bd7-93f5-d9b3742dfc8b was qcow2, converting to raw {{(pid=75113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG nova.privsep.utils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2.part /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2.converted {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUOrsNaH" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c237015e-0962-4892-8480-6e806fa999b2]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BUOrsNaH'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ea5335-71e4-4166-b8cc-cd638232005e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e24e6aa-3638-4b4a-a269-15cce5ab4484]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)
Oct 26 17:32:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)
Oct 26 17:32:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b6dc1f-ba77-404f-b46e-ca00854ce33d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1, portal: 172.16.0.220,3260]
Oct 26 17:32:06 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1, portal: 172.16.0.220,3260] successful.
Oct 26 17:32:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[549ce829-34ba-4494-8caa-912cbe072de4]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG nova.network.neutron [req-01af8b33-88af-4fc5-ad64-e401d1a6a1f2 req-2fcaf5c7-cfe7-46ba-a9e6-162f23649ea7 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Updated VIF entry in instance network info cache for port ed39e3df-1326-462f-bbe4-18fdd101bab0. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG nova.network.neutron [req-01af8b33-88af-4fc5-ad64-e401d1a6a1f2 req-2fcaf5c7-cfe7-46ba-a9e6-162f23649ea7 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Updating instance_info_cache with network_info: [{"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac78d8a-fc80-4bc6-b88e-2635acc61f2d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)
Oct 26 17:32:06 user nova-compute[75113]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 (non-flash)
Oct 26 17:32:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)
Oct 26 17:32:06 user nova-compute[75113]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 (non-flash)
Oct 26 17:32:06 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-01af8b33-88af-4fc5-ad64-e401d1a6a1f2 req-2fcaf5c7-cfe7-46ba-a9e6-162f23649ea7 service nova] Releasing lock "refresh_cache-600b26af-2d9d-4155-83fc-1393e8121c1c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d397380-158a-49af-a794-24f31fb55ffc]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2.part /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2.converted" returned: 0 in 0.568s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2.converted --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "436792927af9717d1ad956c82b1b9f0d18a7aca2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.087s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2 --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "436792927af9717d1ad956c82b1b9f0d18a7aca2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "436792927af9717d1ad956c82b1b9f0d18a7aca2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:06 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2 --force-share --output=json" returned: 0 in 0.171s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2,backing_fmt=raw /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2,backing_fmt=raw /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk 1073741824" returned: 0 in 0.050s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "436792927af9717d1ad956c82b1b9f0d18a7aca2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUOrsNaH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23163363938616131', 'path': '/dev/sdc'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163363938616131', 'path': '/dev/sdc'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG nova.objects.instance [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'flavor' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:32:07 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:32:07 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:32:07 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:32:07 user nova-compute[75113]:   <serial>a2691f21-61f2-4c01-9f4e-b097ccf299f1</serial>
Oct 26 17:32:07 user nova-compute[75113]: </disk>
Oct 26 17:32:07 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436792927af9717d1ad956c82b1b9f0d18a7aca2 --force-share --output=json" returned: 0 in 0.185s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG nova.objects.instance [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'migration_context' on Instance uuid 600b26af-2d9d-4155-83fc-1393e8121c1c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG nova.objects.base [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Object Instance<600b26af-2d9d-4155-83fc-1393e8121c1c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:32:07 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Rebasing disk image.
Oct 26 17:32:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 -F raw /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No VIF found with MAC fa:16:3e:5f:9f:36, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:32:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c69887c4-4d22-429e-b0ba-fe224c79c190 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.644s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 -F raw /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk" returned: 0 in 2.158s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Ensure instance console log exists: /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Start _get_guest_xml network_info=[{"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a82780eee22f92193b383ef75a7b573f',container_format='bare',created_at=2023-10-26T17:30:10Z,direct_url=<?>,disk_format='qcow2',id=f884355c-8141-4bd7-93f5-d9b3742dfc8b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-734630711-shelved',owner='2b425dca1e9645ad99fea4b666b01fab',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T17:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:32:09 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:32:09 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a82780eee22f92193b383ef75a7b573f',container_format='bare',created_at=2023-10-26T17:30:10Z,direct_url=<?>,disk_format='qcow2',id=f884355c-8141-4bd7-93f5-d9b3742dfc8b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-734630711-shelved',owner='2b425dca1e9645ad99fea4b666b01fab',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T17:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.objects.instance [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'vcpu_model' on Instance uuid 600b26af-2d9d-4155-83fc-1393e8121c1c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.objects.base [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Object Instance<600b26af-2d9d-4155-83fc-1393e8121c1c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:28:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-734630711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-734630711',id=44,image_ref='f884355c-8141-4bd7-93f5-d9b3742dfc8b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2133541601',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:28:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b425dca1e9645ad99fea4b666b01fab',ramdisk_id='',reservation_id='r-8q8iwxfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1688117037',owner_user_name='tempest-AttachVolumeShelveTestJSON-1688117037-project-member',shelved_at='2023-10-26T17:30:14.511522',shelved_host='user',shelved_image_id='f884355c-8141-4bd7-93f5-d9b3742dfc8b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:32:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b16af3affdf47f596f944cb83f772e9',uuid=600b26af-2d9d-4155-83fc-1393e8121c1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converting VIF {"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.objects.instance [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'pci_devices' on Instance uuid 600b26af-2d9d-4155-83fc-1393e8121c1c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.objects.base [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Object Instance<600b26af-2d9d-4155-83fc-1393e8121c1c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75113) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:32:09 user nova-compute[75113]:   <uuid>600b26af-2d9d-4155-83fc-1393e8121c1c</uuid>
Oct 26 17:32:09 user nova-compute[75113]:   <name>instance-0000002c</name>
Oct 26 17:32:09 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:32:09 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:32:09 user nova-compute[75113]:   <metadata>
Oct 26 17:32:09 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:32:09 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:32:09 user nova-compute[75113]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-734630711</nova:name>
Oct 26 17:32:09 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:32:09</nova:creationTime>
Oct 26 17:32:09 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:32:09 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:32:09 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:32:09 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:32:09 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:32:09 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:32:09 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:32:09 user nova-compute[75113]:       <nova:owner>
Oct 26 17:32:09 user nova-compute[75113]:         <nova:user uuid="6b16af3affdf47f596f944cb83f772e9">tempest-AttachVolumeShelveTestJSON-1688117037-project-member</nova:user>
Oct 26 17:32:09 user nova-compute[75113]:         <nova:project uuid="2b425dca1e9645ad99fea4b666b01fab">tempest-AttachVolumeShelveTestJSON-1688117037</nova:project>
Oct 26 17:32:09 user nova-compute[75113]:       </nova:owner>
Oct 26 17:32:09 user nova-compute[75113]:       <nova:root type="image" uuid="f884355c-8141-4bd7-93f5-d9b3742dfc8b"/>
Oct 26 17:32:09 user nova-compute[75113]:       <nova:ports>
Oct 26 17:32:09 user nova-compute[75113]:         <nova:port uuid="ed39e3df-1326-462f-bbe4-18fdd101bab0">
Oct 26 17:32:09 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 17:32:09 user nova-compute[75113]:         </nova:port>
Oct 26 17:32:09 user nova-compute[75113]:       </nova:ports>
Oct 26 17:32:09 user nova-compute[75113]:     </nova:instance>
Oct 26 17:32:09 user nova-compute[75113]:   </metadata>
Oct 26 17:32:09 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:32:09 user nova-compute[75113]:     <system>
Oct 26 17:32:09 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:32:09 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:32:09 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:32:09 user nova-compute[75113]:       <entry name="serial">600b26af-2d9d-4155-83fc-1393e8121c1c</entry>
Oct 26 17:32:09 user nova-compute[75113]:       <entry name="uuid">600b26af-2d9d-4155-83fc-1393e8121c1c</entry>
Oct 26 17:32:09 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:32:09 user nova-compute[75113]:     </system>
Oct 26 17:32:09 user nova-compute[75113]:   </sysinfo>
Oct 26 17:32:09 user nova-compute[75113]:   <os>
Oct 26 17:32:09 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:32:09 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:32:09 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:32:09 user nova-compute[75113]:   </os>
Oct 26 17:32:09 user nova-compute[75113]:   <features>
Oct 26 17:32:09 user nova-compute[75113]:     <acpi/>
Oct 26 17:32:09 user nova-compute[75113]:     <apic/>
Oct 26 17:32:09 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:32:09 user nova-compute[75113]:   </features>
Oct 26 17:32:09 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:32:09 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:32:09 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:32:09 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:32:09 user nova-compute[75113]:   </clock>
Oct 26 17:32:09 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:32:09 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:32:09 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:32:09 user nova-compute[75113]:   </cpu>
Oct 26 17:32:09 user nova-compute[75113]:   <devices>
Oct 26 17:32:09 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:32:09 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:32:09 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk"/>
Oct 26 17:32:09 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:32:09 user nova-compute[75113]:     </disk>
Oct 26 17:32:09 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:32:09 user nova-compute[75113]:       <mac address="fa:16:3e:02:b4:b4"/>
Oct 26 17:32:09 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:32:09 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:32:09 user nova-compute[75113]:       <target dev="taped39e3df-13"/>
Oct 26 17:32:09 user nova-compute[75113]:     </interface>
Oct 26 17:32:09 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:32:09 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/console.log" append="off"/>
Oct 26 17:32:09 user nova-compute[75113]:     </serial>
Oct 26 17:32:09 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:32:09 user nova-compute[75113]:     <video>
Oct 26 17:32:09 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:32:09 user nova-compute[75113]:     </video>
Oct 26 17:32:09 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:32:09 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:32:09 user nova-compute[75113]:     </rng>
Oct 26 17:32:09 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:32:09 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:32:09 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:32:09 user nova-compute[75113]:     </memballoon>
Oct 26 17:32:09 user nova-compute[75113]:   </devices>
Oct 26 17:32:09 user nova-compute[75113]: </domain>
Oct 26 17:32:09 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:28:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-734630711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-734630711',id=44,image_ref='f884355c-8141-4bd7-93f5-d9b3742dfc8b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2133541601',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:28:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b425dca1e9645ad99fea4b666b01fab',ramdisk_id='',reservation_id='r-8q8iwxfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1688117037',owner_user_name='tempest-AttachVolumeShelveTestJSON-1688117037-project-member',shelved_at='2023-10-26T17:30:14.511522',shelved_host='user',shelved_image_id='f884355c-8141-4bd7-93f5-d9b3742dfc8b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:32:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b16af3affdf47f596f944cb83f772e9',uuid=600b26af-2d9d-4155-83fc-1393e8121c1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converting VIF {"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG os_vif [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80d490d0-7d4d-5cba-96c6-8b16f52e214c', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped39e3df-13, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped39e3df-13, col_values=(('qos', UUID('7d1fab76-28c0-4b03-81c8-8f133fec017f')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped39e3df-13, col_values=(('external_ids', {'iface-id': 'ed39e3df-1326-462f-bbe4-18fdd101bab0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:b4:b4', 'vm-uuid': '600b26af-2d9d-4155-83fc-1393e8121c1c'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:09 user nova-compute[75113]: INFO os_vif [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13')
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:32:09 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] No VIF found with MAC fa:16:3e:02:b4:b4, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:32:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:10 user nova-compute[75113]: INFO nova.compute.manager [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Detaching volume a2691f21-61f2-4c01-9f4e-b097ccf299f1
Oct 26 17:32:10 user nova-compute[75113]: INFO nova.virt.block_device [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Attempting to driver detach volume a2691f21-61f2-4c01-9f4e-b097ccf299f1 from mountpoint /dev/vdb
Oct 26 17:32:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Attempting to detach device vdb from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:32:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:32:10 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:32:10 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:32:10 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:32:10 user nova-compute[75113]:   <serial>a2691f21-61f2-4c01-9f4e-b097ccf299f1</serial>
Oct 26 17:32:10 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:32:10 user nova-compute[75113]: </disk>
Oct 26 17:32:10 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:32:10 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Successfully detached device vdb from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the persistent domain config.
Oct 26 17:32:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:32:10 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:32:10 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:32:10 user nova-compute[75113]:   <source dev="/dev/sdc"/>
Oct 26 17:32:10 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:32:10 user nova-compute[75113]:   <serial>a2691f21-61f2-4c01-9f4e-b097ccf299f1</serial>
Oct 26 17:32:10 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:32:10 user nova-compute[75113]: </disk>
Oct 26 17:32:10 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:32:11 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:32:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:11 user nova-compute[75113]: DEBUG nova.compute.manager [req-8842cb4c-82d5-4330-827e-18151fb751e5 req-cb8efb15-720f-4f20-a7cd-14cf1f613626 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:32:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8842cb4c-82d5-4330-827e-18151fb751e5 req-cb8efb15-720f-4f20-a7cd-14cf1f613626 service nova] Acquiring lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8842cb4c-82d5-4330-827e-18151fb751e5 req-cb8efb15-720f-4f20-a7cd-14cf1f613626 service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-8842cb4c-82d5-4330-827e-18151fb751e5 req-cb8efb15-720f-4f20-a7cd-14cf1f613626 service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:11 user nova-compute[75113]: DEBUG nova.compute.manager [req-8842cb4c-82d5-4330-827e-18151fb751e5 req-cb8efb15-720f-4f20-a7cd-14cf1f613626 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] No waiting events found dispatching network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:32:11 user nova-compute[75113]: WARNING nova.compute.manager [req-8842cb4c-82d5-4330-827e-18151fb751e5 req-cb8efb15-720f-4f20-a7cd-14cf1f613626 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received unexpected event network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 17:32:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:13 user nova-compute[75113]: DEBUG nova.compute.manager [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:32:13 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:32:13 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Instance spawned successfully.
Oct 26 17:32:13 user nova-compute[75113]: DEBUG nova.compute.manager [req-148199f1-af8d-4d87-b51e-a1c67b0c8088 req-a096b86d-26a2-4b78-adca-bd61217d2f49 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:32:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-148199f1-af8d-4d87-b51e-a1c67b0c8088 req-a096b86d-26a2-4b78-adca-bd61217d2f49 service nova] Acquiring lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-148199f1-af8d-4d87-b51e-a1c67b0c8088 req-a096b86d-26a2-4b78-adca-bd61217d2f49 service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:13 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-148199f1-af8d-4d87-b51e-a1c67b0c8088 req-a096b86d-26a2-4b78-adca-bd61217d2f49 service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:13 user nova-compute[75113]: DEBUG nova.compute.manager [req-148199f1-af8d-4d87-b51e-a1c67b0c8088 req-a096b86d-26a2-4b78-adca-bd61217d2f49 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] No waiting events found dispatching network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:32:13 user nova-compute[75113]: WARNING nova.compute.manager [req-148199f1-af8d-4d87-b51e-a1c67b0c8088 req-a096b86d-26a2-4b78-adca-bd61217d2f49 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received unexpected event network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 17:32:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:32:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-be534754-fb7a-45bb-b839-e9bb9d696be0 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.084s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:22 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:32:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:32:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "e6c9e803-0279-45b7-bebf-711e9ced519e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:26 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:32:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:26 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:32:26 user nova-compute[75113]: INFO nova.compute.claims [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Claim successful on node user
Oct 26 17:32:26 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:32:26 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:32:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:26 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG nova.network.neutron [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:32:27 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:32:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG nova.policy [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47bb03390d7d489d91750653f399125f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30bd0e84d1448158ca783491ed372f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:32:27 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Creating image(s)
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "/opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "/opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk 1073741824" returned: 0 in 0.051s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG nova.network.neutron [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Successfully created port: 109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.197s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:32:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Cannot resize image /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Ensure instance console log exists: /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.network.neutron [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Successfully updated port: 109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "refresh_cache-e6c9e803-0279-45b7-bebf-711e9ced519e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquired lock "refresh_cache-e6c9e803-0279-45b7-bebf-711e9ced519e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.network.neutron [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-77b028f8-d5df-41d4-9b65-4cee21bbb93b req-a8c6250b-3c0d-4f95-85ac-294f7826a8da service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Received event network-changed-109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-77b028f8-d5df-41d4-9b65-4cee21bbb93b req-a8c6250b-3c0d-4f95-85ac-294f7826a8da service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Refreshing instance network info cache due to event network-changed-109fd32f-8607-472d-b174-3c2a1b080858. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-77b028f8-d5df-41d4-9b65-4cee21bbb93b req-a8c6250b-3c0d-4f95-85ac-294f7826a8da service nova] Acquiring lock "refresh_cache-e6c9e803-0279-45b7-bebf-711e9ced519e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.network.neutron [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.network.neutron [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Updating instance_info_cache with network_info: [{"id": "109fd32f-8607-472d-b174-3c2a1b080858", "address": "fa:16:3e:98:bf:ed", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109fd32f-86", "ovs_interfaceid": "109fd32f-8607-472d-b174-3c2a1b080858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Releasing lock "refresh_cache-e6c9e803-0279-45b7-bebf-711e9ced519e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Instance network_info: |[{"id": "109fd32f-8607-472d-b174-3c2a1b080858", "address": "fa:16:3e:98:bf:ed", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109fd32f-86", "ovs_interfaceid": "109fd32f-8607-472d-b174-3c2a1b080858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-77b028f8-d5df-41d4-9b65-4cee21bbb93b req-a8c6250b-3c0d-4f95-85ac-294f7826a8da service nova] Acquired lock "refresh_cache-e6c9e803-0279-45b7-bebf-711e9ced519e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.network.neutron [req-77b028f8-d5df-41d4-9b65-4cee21bbb93b req-a8c6250b-3c0d-4f95-85ac-294f7826a8da service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Refreshing network info cache for port 109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Start _get_guest_xml network_info=[{"id": "109fd32f-8607-472d-b174-3c2a1b080858", "address": "fa:16:3e:98:bf:ed", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109fd32f-86", "ovs_interfaceid": "109fd32f-8607-472d-b174-3c2a1b080858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:32:28 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:32:28 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1494941515',display_name='tempest-AttachVolumeNegativeTest-server-1494941515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1494941515',id=46,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/DkEG0wwiSBA6oPzZo//upnl+HdqNdHZolS6Nik4I/KkBUiWNZyu06txQPab4qLKIxnPOwHf2IR2gFI7tffJB2QueQdtfcDzK/F6UGe+dL2ueZNRvnQZwJThRjr0DVJA==',key_name='tempest-keypair-1913146126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30bd0e84d1448158ca783491ed372f5',ramdisk_id='',reservation_id='r-6ge7us1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1111816565',owner_user_name='tempest-AttachVolumeNegativeTest-1111816565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47bb03390d7d489d91750653f399125f',uuid=e6c9e803-0279-45b7-bebf-711e9ced519e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "109fd32f-8607-472d-b174-3c2a1b080858", "address": "fa:16:3e:98:bf:ed", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109fd32f-86", "ovs_interfaceid": "109fd32f-8607-472d-b174-3c2a1b080858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converting VIF {"id": "109fd32f-8607-472d-b174-3c2a1b080858", "address": "fa:16:3e:98:bf:ed", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109fd32f-86", "ovs_interfaceid": "109fd32f-8607-472d-b174-3c2a1b080858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:bf:ed,bridge_name='br-int',has_traffic_filtering=True,id=109fd32f-8607-472d-b174-3c2a1b080858,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109fd32f-86') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.objects.instance [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'pci_devices' on Instance uuid e6c9e803-0279-45b7-bebf-711e9ced519e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:32:28 user nova-compute[75113]:   <uuid>e6c9e803-0279-45b7-bebf-711e9ced519e</uuid>
Oct 26 17:32:28 user nova-compute[75113]:   <name>instance-0000002e</name>
Oct 26 17:32:28 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:32:28 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:32:28 user nova-compute[75113]:   <metadata>
Oct 26 17:32:28 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:32:28 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:32:28 user nova-compute[75113]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1494941515</nova:name>
Oct 26 17:32:28 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:32:28</nova:creationTime>
Oct 26 17:32:28 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:32:28 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:32:28 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:32:28 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:32:28 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:32:28 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:32:28 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:32:28 user nova-compute[75113]:       <nova:owner>
Oct 26 17:32:28 user nova-compute[75113]:         <nova:user uuid="47bb03390d7d489d91750653f399125f">tempest-AttachVolumeNegativeTest-1111816565-project-member</nova:user>
Oct 26 17:32:28 user nova-compute[75113]:         <nova:project uuid="c30bd0e84d1448158ca783491ed372f5">tempest-AttachVolumeNegativeTest-1111816565</nova:project>
Oct 26 17:32:28 user nova-compute[75113]:       </nova:owner>
Oct 26 17:32:28 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:32:28 user nova-compute[75113]:       <nova:ports>
Oct 26 17:32:28 user nova-compute[75113]:         <nova:port uuid="109fd32f-8607-472d-b174-3c2a1b080858">
Oct 26 17:32:28 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 17:32:28 user nova-compute[75113]:         </nova:port>
Oct 26 17:32:28 user nova-compute[75113]:       </nova:ports>
Oct 26 17:32:28 user nova-compute[75113]:     </nova:instance>
Oct 26 17:32:28 user nova-compute[75113]:   </metadata>
Oct 26 17:32:28 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:32:28 user nova-compute[75113]:     <system>
Oct 26 17:32:28 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:32:28 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:32:28 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:32:28 user nova-compute[75113]:       <entry name="serial">e6c9e803-0279-45b7-bebf-711e9ced519e</entry>
Oct 26 17:32:28 user nova-compute[75113]:       <entry name="uuid">e6c9e803-0279-45b7-bebf-711e9ced519e</entry>
Oct 26 17:32:28 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:32:28 user nova-compute[75113]:     </system>
Oct 26 17:32:28 user nova-compute[75113]:   </sysinfo>
Oct 26 17:32:28 user nova-compute[75113]:   <os>
Oct 26 17:32:28 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:32:28 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:32:28 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:32:28 user nova-compute[75113]:   </os>
Oct 26 17:32:28 user nova-compute[75113]:   <features>
Oct 26 17:32:28 user nova-compute[75113]:     <acpi/>
Oct 26 17:32:28 user nova-compute[75113]:     <apic/>
Oct 26 17:32:28 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:32:28 user nova-compute[75113]:   </features>
Oct 26 17:32:28 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:32:28 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:32:28 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:32:28 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:32:28 user nova-compute[75113]:   </clock>
Oct 26 17:32:28 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:32:28 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:32:28 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:32:28 user nova-compute[75113]:   </cpu>
Oct 26 17:32:28 user nova-compute[75113]:   <devices>
Oct 26 17:32:28 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:32:28 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:32:28 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk"/>
Oct 26 17:32:28 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:32:28 user nova-compute[75113]:     </disk>
Oct 26 17:32:28 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:32:28 user nova-compute[75113]:       <mac address="fa:16:3e:98:bf:ed"/>
Oct 26 17:32:28 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:32:28 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:32:28 user nova-compute[75113]:       <target dev="tap109fd32f-86"/>
Oct 26 17:32:28 user nova-compute[75113]:     </interface>
Oct 26 17:32:28 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:32:28 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/console.log" append="off"/>
Oct 26 17:32:28 user nova-compute[75113]:     </serial>
Oct 26 17:32:28 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:32:28 user nova-compute[75113]:     <video>
Oct 26 17:32:28 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:32:28 user nova-compute[75113]:     </video>
Oct 26 17:32:28 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:32:28 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:32:28 user nova-compute[75113]:     </rng>
Oct 26 17:32:28 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:32:28 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:32:28 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:32:28 user nova-compute[75113]:     </memballoon>
Oct 26 17:32:28 user nova-compute[75113]:   </devices>
Oct 26 17:32:28 user nova-compute[75113]: </domain>
Oct 26 17:32:28 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1494941515',display_name='tempest-AttachVolumeNegativeTest-server-1494941515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1494941515',id=46,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/DkEG0wwiSBA6oPzZo//upnl+HdqNdHZolS6Nik4I/KkBUiWNZyu06txQPab4qLKIxnPOwHf2IR2gFI7tffJB2QueQdtfcDzK/F6UGe+dL2ueZNRvnQZwJThRjr0DVJA==',key_name='tempest-keypair-1913146126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30bd0e84d1448158ca783491ed372f5',ramdisk_id='',reservation_id='r-6ge7us1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1111816565',owner_user_name='tempest-AttachVolumeNegativeTest-1111816565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47bb03390d7d489d91750653f399125f',uuid=e6c9e803-0279-45b7-bebf-711e9ced519e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "109fd32f-8607-472d-b174-3c2a1b080858", "address": "fa:16:3e:98:bf:ed", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109fd32f-86", "ovs_interfaceid": "109fd32f-8607-472d-b174-3c2a1b080858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converting VIF {"id": "109fd32f-8607-472d-b174-3c2a1b080858", "address": "fa:16:3e:98:bf:ed", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109fd32f-86", "ovs_interfaceid": "109fd32f-8607-472d-b174-3c2a1b080858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:bf:ed,bridge_name='br-int',has_traffic_filtering=True,id=109fd32f-8607-472d-b174-3c2a1b080858,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109fd32f-86') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG os_vif [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:bf:ed,bridge_name='br-int',has_traffic_filtering=True,id=109fd32f-8607-472d-b174-3c2a1b080858,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109fd32f-86') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21888cf1-d65e-52cf-9935-e7d236027f2c', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap109fd32f-86, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap109fd32f-86, col_values=(('qos', UUID('14b20427-088f-4ccb-85da-8cdec9c3fc88')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap109fd32f-86, col_values=(('external_ids', {'iface-id': '109fd32f-8607-472d-b174-3c2a1b080858', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:bf:ed', 'vm-uuid': 'e6c9e803-0279-45b7-bebf-711e9ced519e'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:28 user nova-compute[75113]: INFO os_vif [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:bf:ed,bridge_name='br-int',has_traffic_filtering=True,id=109fd32f-8607-472d-b174-3c2a1b080858,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109fd32f-86')
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:32:28 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No VIF found with MAC fa:16:3e:98:bf:ed, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:32:29 user nova-compute[75113]: DEBUG nova.network.neutron [req-77b028f8-d5df-41d4-9b65-4cee21bbb93b req-a8c6250b-3c0d-4f95-85ac-294f7826a8da service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Updated VIF entry in instance network info cache for port 109fd32f-8607-472d-b174-3c2a1b080858. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:32:29 user nova-compute[75113]: DEBUG nova.network.neutron [req-77b028f8-d5df-41d4-9b65-4cee21bbb93b req-a8c6250b-3c0d-4f95-85ac-294f7826a8da service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Updating instance_info_cache with network_info: [{"id": "109fd32f-8607-472d-b174-3c2a1b080858", "address": "fa:16:3e:98:bf:ed", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109fd32f-86", "ovs_interfaceid": "109fd32f-8607-472d-b174-3c2a1b080858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:32:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-77b028f8-d5df-41d4-9b65-4cee21bbb93b req-a8c6250b-3c0d-4f95-85ac-294f7826a8da service nova] Releasing lock "refresh_cache-e6c9e803-0279-45b7-bebf-711e9ced519e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:32:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-5bb4b3ae-2cca-4781-8a1d-f894123d17d7 req-14ed156a-5368-46db-bb3f-7e449ccfab8d service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Received event network-vif-plugged-109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:32:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5bb4b3ae-2cca-4781-8a1d-f894123d17d7 req-14ed156a-5368-46db-bb3f-7e449ccfab8d service nova] Acquiring lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5bb4b3ae-2cca-4781-8a1d-f894123d17d7 req-14ed156a-5368-46db-bb3f-7e449ccfab8d service nova] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-5bb4b3ae-2cca-4781-8a1d-f894123d17d7 req-14ed156a-5368-46db-bb3f-7e449ccfab8d service nova] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-5bb4b3ae-2cca-4781-8a1d-f894123d17d7 req-14ed156a-5368-46db-bb3f-7e449ccfab8d service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] No waiting events found dispatching network-vif-plugged-109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:32:30 user nova-compute[75113]: WARNING nova.compute.manager [req-5bb4b3ae-2cca-4781-8a1d-f894123d17d7 req-14ed156a-5368-46db-bb3f-7e449ccfab8d service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Received unexpected event network-vif-plugged-109fd32f-8607-472d-b174-3c2a1b080858 for instance with vm_state building and task_state spawning.
Oct 26 17:32:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:30 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:31 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 97199d01-06b9-4e73-a23e-2b6110544afe is timed out.
Oct 26 17:32:31 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Successfully detached device vdb from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the live domain config.
Oct 26 17:32:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUOrsNaH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:32:31 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa3f47c-5d43-4579-849c-b864ed52b35f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:32:31 user nova-compute[75113]: No targets found.
Oct 26 17:32:31 user nova-compute[75113]: iSNS:
Oct 26 17:32:31 user nova-compute[75113]: No targets found.
Oct 26 17:32:31 user nova-compute[75113]: STATIC:
Oct 26 17:32:31 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a
Oct 26 17:32:31 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:32:31 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:32:31 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1
Oct 26 17:32:31 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:32:31 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:32:31 user nova-compute[75113]: FIRMWARE:
Oct 26 17:32:31 user nova-compute[75113]: No targets found.
Oct 26 17:32:31 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:32:31 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:32:31 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45f9daa-f14d-4d09-9e8e-47c751a39a2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[442c4bdd-4b53-4e4c-a0b8-d4a1c028df2c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)
Oct 26 17:32:31 user nova-compute[75113]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 (non-flash)
Oct 26 17:32:31 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)
Oct 26 17:32:31 user nova-compute[75113]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 (non-flash)
Oct 26 17:32:31 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f492c38e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1'): ({'sdc'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Removing single pathed devices sdc {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b2a411-71a9-48b7-a1d7-82c1377ff6c3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bcd2aa-2918-494b-a75b-2d3313cdb561]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Flushing IO for device /dev/sdc {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[88be4381-3150-4694-8d22-397ff6191977]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefbe05c-ad9e-4d67-b68a-3f9e7ae557fd]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8a5779-04ee-4828-a9a5-65f0830b9470]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cfbf7d-7763-4a9d-b984-e6c7106e447a]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1, portal: 172.16.0.220,3260]
Oct 26 17:32:31 user nova-compute[75113]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1, portal: 172.16.0.220,3260] successful.
Oct 26 17:32:31 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2691f21-61f2-4c01-9f4e-b097ccf299f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a80823-9019-4607-b3a6-4cfd426ac726]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] <== disconnect_volume: return (297ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:32:31 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:32:32 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Instance spawned successfully.
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:32:32 user nova-compute[75113]: INFO nova.compute.manager [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Took 5.14 seconds to spawn the instance on the hypervisor.
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.compute.manager [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:32:32 user nova-compute[75113]: INFO nova.compute.manager [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Took 5.75 seconds to build instance.
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.compute.manager [req-05f6e10d-8366-499f-a852-995970b0fe04 req-24578859-9e9a-4cd8-ac81-172aabda6a04 service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Received event network-vif-plugged-109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-05f6e10d-8366-499f-a852-995970b0fe04 req-24578859-9e9a-4cd8-ac81-172aabda6a04 service nova] Acquiring lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-05f6e10d-8366-499f-a852-995970b0fe04 req-24578859-9e9a-4cd8-ac81-172aabda6a04 service nova] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-05f6e10d-8366-499f-a852-995970b0fe04 req-24578859-9e9a-4cd8-ac81-172aabda6a04 service nova] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.compute.manager [req-05f6e10d-8366-499f-a852-995970b0fe04 req-24578859-9e9a-4cd8-ac81-172aabda6a04 service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] No waiting events found dispatching network-vif-plugged-109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:32:32 user nova-compute[75113]: WARNING nova.compute.manager [req-05f6e10d-8366-499f-a852-995970b0fe04 req-24578859-9e9a-4cd8-ac81-172aabda6a04 service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Received unexpected event network-vif-plugged-109fd32f-8607-472d-b174-3c2a1b080858 for instance with vm_state active and task_state None.
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-55fb81fe-a99f-43b6-82e5-905021dc5ad5 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.856s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG nova.objects.instance [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'flavor' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-ace9cb43-fd36-4872-97b7-cf0ba48ef161 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.059s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:33 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:32:33 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:32:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8472MB free_disk=24.990131378173828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:32:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 97199d01-06b9-4e73-a23e-2b6110544afe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:32:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance d199214d-d2d4-4e03-b88a-756fcc1e9093 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:32:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 600b26af-2d9d-4155-83fc-1393e8121c1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:32:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e6c9e803-0279-45b7-bebf-711e9ced519e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:32:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:32:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:32:34 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:32:34 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:32:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:32:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:36 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:32:36 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:32:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:32:36 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:32:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:32:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:32:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:32:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:32:36 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:32:36 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:32:36 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updating instance_info_cache with network_info: [{"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:32:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:32:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:32:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:46 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:32:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "d199214d-d2d4-4e03-b88a-756fcc1e9093" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:52 user nova-compute[75113]: INFO nova.compute.manager [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Terminating instance
Oct 26 17:32:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:32:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:53 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Instance destroyed successfully.
Oct 26 17:32:53 user nova-compute[75113]: DEBUG nova.objects.instance [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lazy-loading 'resources' on Instance uuid d199214d-d2d4-4e03-b88a-756fcc1e9093 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1531694038',display_name='tempest-TestVolumeBootPattern-server-1531694038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1531694038',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-egnw8etv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:31:30Z,user_data=None,user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=d199214d-d2d4-4e03-b88a-756fcc1e9093,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "637a091d-e2d0-47ad-b108-6685bbc395e9", "address": "fa:16:3e:e6:93:46", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a091d-e2", "ovs_interfaceid": "637a091d-e2d0-47ad-b108-6685bbc395e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "637a091d-e2d0-47ad-b108-6685bbc395e9", "address": "fa:16:3e:e6:93:46", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a091d-e2", "ovs_interfaceid": "637a091d-e2d0-47ad-b108-6685bbc395e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:46,bridge_name='br-int',has_traffic_filtering=True,id=637a091d-e2d0-47ad-b108-6685bbc395e9,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a091d-e2') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_vif [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:46,bridge_name='br-int',has_traffic_filtering=True,id=637a091d-e2d0-47ad-b108-6685bbc395e9,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a091d-e2') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap637a091d-e2, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3a73e4c-a3a8-423e-9493-1ac27ca4a0cf) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:32:53 user nova-compute[75113]: INFO os_vif [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:46,bridge_name='br-int',has_traffic_filtering=True,id=637a091d-e2d0-47ad-b108-6685bbc395e9,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a091d-e2')
Oct 26 17:32:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjBwYUFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:32:53 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f648e566-814b-497d-bb1d-5f9e2030e753]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:32:53 user nova-compute[75113]: No targets found.
Oct 26 17:32:53 user nova-compute[75113]: iSNS:
Oct 26 17:32:53 user nova-compute[75113]: No targets found.
Oct 26 17:32:53 user nova-compute[75113]: STATIC:
Oct 26 17:32:53 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a
Oct 26 17:32:53 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:32:53 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:32:53 user nova-compute[75113]: FIRMWARE:
Oct 26 17:32:53 user nova-compute[75113]: No targets found.
Oct 26 17:32:53 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:32:53 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:32:53 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-f9dc3023-7cf6-4e74-bb86-30998eeda366 req-7bc81d7e-4394-4b05-a159-35830200362c service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Received event network-vif-unplugged-637a091d-e2d0-47ad-b108-6685bbc395e9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f9dc3023-7cf6-4e74-bb86-30998eeda366 req-7bc81d7e-4394-4b05-a159-35830200362c service nova] Acquiring lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f9dc3023-7cf6-4e74-bb86-30998eeda366 req-7bc81d7e-4394-4b05-a159-35830200362c service nova] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f9dc3023-7cf6-4e74-bb86-30998eeda366 req-7bc81d7e-4394-4b05-a159-35830200362c service nova] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-f9dc3023-7cf6-4e74-bb86-30998eeda366 req-7bc81d7e-4394-4b05-a159-35830200362c service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] No waiting events found dispatching network-vif-unplugged-637a091d-e2d0-47ad-b108-6685bbc395e9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-f9dc3023-7cf6-4e74-bb86-30998eeda366 req-7bc81d7e-4394-4b05-a159-35830200362c service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Received event network-vif-unplugged-637a091d-e2d0-47ad-b108-6685bbc395e9 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[55537f68-0159-4497-9789-0679457b5824]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2aefa9-188f-46bd-82ab-9d2c0a2c3cf4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)
Oct 26 17:32:53 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a (non-flash)
Oct 26 17:32:53 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f492c1b35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e18fca-0868-4297-86d3-ecc003aeeb90]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68c1f2d-3f09-4fed-aa01-162b961d68d6]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e930308a-9a21-44c6-98ad-e8d229e7b411]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e467de4-8ef3-4469-9c71-929c13572464]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26535663364303335', '/dev/disk/by-id/scsi-1SCST_BIOb253b122-e5f3d03570a996a5', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b253b122') {{(pid=86603) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb42272-a9d9-42f0-8351-efe65eb5d82e]: (4, None) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f61102-e700-4e65-b3e0-73245d8d3c60]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e84255-43f3-4177-9079-16a4bad0917f]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a, portal: 172.16.0.220,3260]
Oct 26 17:32:53 user nova-compute[75113]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a, portal: 172.16.0.220,3260] successful.
Oct 26 17:32:53 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59220498-b88c-4c8a-b5cc-2b4191bd636a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6813a734-1e80-4141-98aa-01a20523a25c]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== disconnect_volume: return (305ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:32:53 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Deleting instance files /opt/stack/data/nova/instances/d199214d-d2d4-4e03-b88a-756fcc1e9093_del
Oct 26 17:32:53 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Deletion of /opt/stack/data/nova/instances/d199214d-d2d4-4e03-b88a-756fcc1e9093_del complete
Oct 26 17:32:53 user nova-compute[75113]: INFO nova.compute.manager [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 26 17:32:53 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:32:53 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:32:54 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:32:54 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Took 0.92 seconds to deallocate network for instance.
Oct 26 17:32:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-1b5ef284-2ae7-457d-bc33-8969385c3d65 req-0f180f3b-81f2-4b34-a241-c08dbee5f81a service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Received event network-vif-deleted-637a091d-e2d0-47ad-b108-6685bbc395e9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:32:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-316fdf41-bfa1-4a94-90ed-3a231aed3f91 req-68720ecf-69b0-438b-953e-7f29609c7591 service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Received event network-vif-plugged-637a091d-e2d0-47ad-b108-6685bbc395e9 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:32:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-316fdf41-bfa1-4a94-90ed-3a231aed3f91 req-68720ecf-69b0-438b-953e-7f29609c7591 service nova] Acquiring lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-316fdf41-bfa1-4a94-90ed-3a231aed3f91 req-68720ecf-69b0-438b-953e-7f29609c7591 service nova] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-316fdf41-bfa1-4a94-90ed-3a231aed3f91 req-68720ecf-69b0-438b-953e-7f29609c7591 service nova] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-316fdf41-bfa1-4a94-90ed-3a231aed3f91 req-68720ecf-69b0-438b-953e-7f29609c7591 service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] No waiting events found dispatching network-vif-plugged-637a091d-e2d0-47ad-b108-6685bbc395e9 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:32:55 user nova-compute[75113]: WARNING nova.compute.manager [req-316fdf41-bfa1-4a94-90ed-3a231aed3f91 req-68720ecf-69b0-438b-953e-7f29609c7591 service nova] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Received unexpected event network-vif-plugged-637a091d-e2d0-47ad-b108-6685bbc395e9 for instance with vm_state active and task_state deleting.
Oct 26 17:32:55 user nova-compute[75113]: INFO nova.compute.manager [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Took 0.85 seconds to detach 1 volumes for instance.
Oct 26 17:32:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: d199214d-d2d4-4e03-b88a-756fcc1e9093] Deleting volume: 59220498-b88c-4c8a-b5cc-2b4191bd636a {{(pid=75113) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 17:32:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:32:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:32:55 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:32:55 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:32:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:55 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Deleted allocations for instance d199214d-d2d4-4e03-b88a-756fcc1e9093
Oct 26 17:32:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-9a58c524-ea5b-487a-898e-a96c5cc63111 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "d199214d-d2d4-4e03-b88a-756fcc1e9093" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.438s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:32:57 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:32:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:32:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG nova.objects.instance [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'flavor' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:33:05 user nova-compute[75113]: INFO nova.compute.manager [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Attaching volume c7542323-0f95-4ebd-8d68-06c3010ffa38 to /dev/vdb
Oct 26 17:33:05 user nova-compute[75113]: DEBUG os_brick.utils [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1cd99c-53cf-4ed2-b0da-c3e9497c422a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0ad0da-8bc6-4717-86a8-18b0bcb98a91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[504f1e76-3d54-49dd-bc5a-999708acd702]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aa15b0-7cd3-4591-9872-7fb2064afe1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:33:05 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:33:05 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96aaa00-9311-4c66-b0f7-838f94d01b85]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG os_brick.utils [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:33:05 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updating existing volume attachment record: a9fd33f8-ca1b-4dae-8140-44385771a458 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:33:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:22 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:33:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJFtraHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:33:24 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:33:24 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:33:24 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9bdf1f-f78c-429b-9c95-1af6ac78adee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:33:24 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ccb9f9-9659-4b0a-972a-42b123871ef6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38] added
Oct 26 17:33:24 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[657f3e3f-8a5d-4dcb-bacf-14f2b14ac889]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f284fe1a-68da-47e7-9ee3-e89478054a94]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJFtraHT {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJFtraHT" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cab12c-7b6d-426b-81f4-3f28ce199a5d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XJFtraHT'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5aa850-ddac-488b-b272-f8ebcbf5d48d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[08301e10-26e3-458c-9a87-7650175291fb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:33:24 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:33:24 user nova-compute[75113]:  {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:33:24 user nova-compute[75113]: WARNING os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 17:33:24 user nova-compute[75113]: 
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aefb3be-059f-4fb1-9818-b1fd1d066e9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38, portal: 172.16.0.220,3260]
Oct 26 17:33:24 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38, portal: 172.16.0.220,3260] successful.
Oct 26 17:33:24 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49ab61b-8749-4d98-9bb9-a04e7e7fa9dc]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb43f6b0-840c-4cbe-9844-ee420a07a082]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 (non-flash)
Oct 26 17:33:24 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 (non-flash)
Oct 26 17:33:24 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7277d1cf-614b-43e5-81e5-4b5f7c1740fb]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:24 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:33:25 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:33:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJFtraHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:33:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:33:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23336383336363038', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:33:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336383336363038', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:33:25 user nova-compute[75113]: DEBUG nova.objects.instance [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'flavor' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:33:25 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:33:25 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:33:25 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:33:25 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:33:25 user nova-compute[75113]:   <serial>c7542323-0f95-4ebd-8d68-06c3010ffa38</serial>
Oct 26 17:33:25 user nova-compute[75113]: </disk>
Oct 26 17:33:25 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:33:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:33:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:33:26 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] No VIF found with MAC fa:16:3e:5f:9f:36, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:33:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-bf510556-01fd-47ba-8a58-14b7f5a5677c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.444s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:33:27 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:33:27 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:33:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:33:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:33:28 user nova-compute[75113]: INFO nova.compute.manager [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Detaching volume c7542323-0f95-4ebd-8d68-06c3010ffa38
Oct 26 17:33:28 user nova-compute[75113]: INFO nova.virt.block_device [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Attempting to driver detach volume c7542323-0f95-4ebd-8d68-06c3010ffa38 from mountpoint /dev/vdb
Oct 26 17:33:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Attempting to detach device vdb from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:33:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:33:29 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:33:29 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:33:29 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:33:29 user nova-compute[75113]:   <serial>c7542323-0f95-4ebd-8d68-06c3010ffa38</serial>
Oct 26 17:33:29 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:33:29 user nova-compute[75113]: </disk>
Oct 26 17:33:29 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:33:29 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Successfully detached device vdb from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the persistent domain config.
Oct 26 17:33:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:33:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:33:29 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:33:29 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:33:29 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:33:29 user nova-compute[75113]:   <serial>c7542323-0f95-4ebd-8d68-06c3010ffa38</serial>
Oct 26 17:33:29 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:33:29 user nova-compute[75113]: </disk>
Oct 26 17:33:29 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:33:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:33:32 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:33:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:33:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:33:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:33:32 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:33:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:32 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:33 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:33:33 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:33:33 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8578MB free_disk=24.960891723632812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:33:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:33:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:33:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 97199d01-06b9-4e73-a23e-2b6110544afe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:33:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 600b26af-2d9d-4155-83fc-1393e8121c1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:33:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e6c9e803-0279-45b7-bebf-711e9ced519e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:33:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:33:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:33:34 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:33:34 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:33:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:33:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:33:35 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:33:36 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:33:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:33:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-e6c9e803-0279-45b7-bebf-711e9ced519e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:33:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-e6c9e803-0279-45b7-bebf-711e9ced519e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:33:36 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:33:36 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Updating instance_info_cache with network_info: [{"id": "109fd32f-8607-472d-b174-3c2a1b080858", "address": "fa:16:3e:98:bf:ed", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109fd32f-86", "ovs_interfaceid": "109fd32f-8607-472d-b174-3c2a1b080858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:33:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-e6c9e803-0279-45b7-bebf-711e9ced519e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:33:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:33:36 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:33:36 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:33:37 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:33:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:47 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:33:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:33:49 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 97199d01-06b9-4e73-a23e-2b6110544afe is timed out.
Oct 26 17:33:49 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Successfully detached device vdb from instance 97199d01-06b9-4e73-a23e-2b6110544afe from the live domain config.
Oct 26 17:33:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJFtraHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:33:49 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[54abda75-2a31-40ef-a36a-3b80b0c19146]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:33:49 user nova-compute[75113]: No targets found.
Oct 26 17:33:49 user nova-compute[75113]: iSNS:
Oct 26 17:33:49 user nova-compute[75113]: No targets found.
Oct 26 17:33:49 user nova-compute[75113]: STATIC:
Oct 26 17:33:49 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38
Oct 26 17:33:49 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:33:49 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:33:49 user nova-compute[75113]: FIRMWARE:
Oct 26 17:33:49 user nova-compute[75113]: No targets found.
Oct 26 17:33:49 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:33:49 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:33:49 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35a20ef-85da-4b8f-b67b-b7845c09d879]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7157bb7d-3398-453e-90b5-9e37e48eb592]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 (non-flash)
Oct 26 17:33:49 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 (non-flash)
Oct 26 17:33:49 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914210700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5123c9a3-49bc-4fba-814c-e72b4e716f7f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3e2abf-530e-4b03-a126-0acebb60ef45]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6a8c41-5176-47a5-9a0f-5bf709aadd2a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d1b4fc-540c-4860-a481-7b005bc4ecb1]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[14603cb9-33cc-48b2-815f-764d97c45865]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab03e27-191b-4a91-a311-6bb386f93c39]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38, portal: 172.16.0.220,3260]
Oct 26 17:33:49 user nova-compute[75113]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38, portal: 172.16.0.220,3260] successful.
Oct 26 17:33:49 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7542323-0f95-4ebd-8d68-06c3010ffa38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[291f9543-2908-42ff-8283-6892bda85f07]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] <== disconnect_volume: return (307ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:33:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:33:50 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'flavor' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:33:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2f42f177-6840-4bc2-970a-832d7b9a7003 tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.834s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:33:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "600b26af-2d9d-4155-83fc-1393e8121c1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:33:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:33:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:33:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:33:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:33:53 user nova-compute[75113]: INFO nova.compute.manager [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Terminating instance
Oct 26 17:33:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:33:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-3195d083-2c44-4ab5-b3b1-690e7df90632 req-20ce81c4-dd92-4a45-b4e2-4e2fff2cb632 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-vif-unplugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3195d083-2c44-4ab5-b3b1-690e7df90632 req-20ce81c4-dd92-4a45-b4e2-4e2fff2cb632 service nova] Acquiring lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3195d083-2c44-4ab5-b3b1-690e7df90632 req-20ce81c4-dd92-4a45-b4e2-4e2fff2cb632 service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3195d083-2c44-4ab5-b3b1-690e7df90632 req-20ce81c4-dd92-4a45-b4e2-4e2fff2cb632 service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-3195d083-2c44-4ab5-b3b1-690e7df90632 req-20ce81c4-dd92-4a45-b4e2-4e2fff2cb632 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] No waiting events found dispatching network-vif-unplugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG nova.compute.manager [req-3195d083-2c44-4ab5-b3b1-690e7df90632 req-20ce81c4-dd92-4a45-b4e2-4e2fff2cb632 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-vif-unplugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:54 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Instance destroyed successfully.
Oct 26 17:33:54 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lazy-loading 'resources' on Instance uuid 600b26af-2d9d-4155-83fc-1393e8121c1c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T17:28:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-734630711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-734630711',id=44,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBnU3iSIJrBhxGCzHoP9+OnC/LPQopOMDvVAXJ5j15sWMGjCODnHZYshasGGumTfYqhQ4KlICoR5C/Sh/MS0tAyB1Asc1Zngea5l3dj6Bk7KD1wQ1LDriDHlGPjQlZ+Bw==',key_name='tempest-keypair-2133541601',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b425dca1e9645ad99fea4b666b01fab',ramdisk_id='',reservation_id='r-8q8iwxfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1688117037',owner_user_name='tempest-AttachVolumeShelveTestJSON-1688117037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:32:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b16af3affdf47f596f944cb83f772e9',uuid=600b26af-2d9d-4155-83fc-1393e8121c1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converting VIF {"id": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "address": "fa:16:3e:02:b4:b4", "network": {"id": "ba48e36a-a3fc-4107-9e18-e37910b331b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1463784715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b425dca1e9645ad99fea4b666b01fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped39e3df-13", "ovs_interfaceid": "ed39e3df-1326-462f-bbe4-18fdd101bab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG os_vif [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped39e3df-13, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d1fab76-28c0-4b03-81c8-8f133fec017f) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:54 user nova-compute[75113]: INFO os_vif [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:b4,bridge_name='br-int',has_traffic_filtering=True,id=ed39e3df-1326-462f-bbe4-18fdd101bab0,network=Network(ba48e36a-a3fc-4107-9e18-e37910b331b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped39e3df-13')
Oct 26 17:33:54 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Deleting instance files /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c_del
Oct 26 17:33:54 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Deletion of /opt/stack/data/nova/instances/600b26af-2d9d-4155-83fc-1393e8121c1c_del complete
Oct 26 17:33:54 user nova-compute[75113]: INFO nova.compute.manager [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 26 17:33:54 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:33:54 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:33:55 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:33:55 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Took 0.85 seconds to deallocate network for instance.
Oct 26 17:33:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-b08e6a0b-1161-402d-926c-8f456792bb32 req-47fc4739-b61a-493e-9d47-512ac5f23881 service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-vif-deleted-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:33:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:33:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:33:55 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:33:55 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:33:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:33:55 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Deleted allocations for instance 600b26af-2d9d-4155-83fc-1393e8121c1c
Oct 26 17:33:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a255db47-dd8a-4e38-a869-0fcddb20eda2 tempest-AttachVolumeShelveTestJSON-1688117037 tempest-AttachVolumeShelveTestJSON-1688117037-project-member] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.074s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:33:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-ee09c323-3d7e-431e-a716-3b9b3771d62d req-f14856d3-b426-458d-9149-e1f0d92d73cc service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received event network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:33:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee09c323-3d7e-431e-a716-3b9b3771d62d req-f14856d3-b426-458d-9149-e1f0d92d73cc service nova] Acquiring lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:33:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee09c323-3d7e-431e-a716-3b9b3771d62d req-f14856d3-b426-458d-9149-e1f0d92d73cc service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:33:56 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ee09c323-3d7e-431e-a716-3b9b3771d62d req-f14856d3-b426-458d-9149-e1f0d92d73cc service nova] Lock "600b26af-2d9d-4155-83fc-1393e8121c1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:33:56 user nova-compute[75113]: DEBUG nova.compute.manager [req-ee09c323-3d7e-431e-a716-3b9b3771d62d req-f14856d3-b426-458d-9149-e1f0d92d73cc service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] No waiting events found dispatching network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:33:56 user nova-compute[75113]: WARNING nova.compute.manager [req-ee09c323-3d7e-431e-a716-3b9b3771d62d req-f14856d3-b426-458d-9149-e1f0d92d73cc service nova] [instance: 600b26af-2d9d-4155-83fc-1393e8121c1c] Received unexpected event network-vif-plugged-ed39e3df-1326-462f-bbe4-18fdd101bab0 for instance with vm_state deleted and task_state None.
Oct 26 17:33:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:33:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:34:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:17 user nova-compute[75113]: DEBUG nova.compute.manager [req-6bc832b9-7e44-44e9-8aaa-f3de987bd068 req-89dcd4a1-d966-4954-8e20-d0954dc5aa2a service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Received event network-changed-109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:34:17 user nova-compute[75113]: DEBUG nova.compute.manager [req-6bc832b9-7e44-44e9-8aaa-f3de987bd068 req-89dcd4a1-d966-4954-8e20-d0954dc5aa2a service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Refreshing instance network info cache due to event network-changed-109fd32f-8607-472d-b174-3c2a1b080858. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:34:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6bc832b9-7e44-44e9-8aaa-f3de987bd068 req-89dcd4a1-d966-4954-8e20-d0954dc5aa2a service nova] Acquiring lock "refresh_cache-e6c9e803-0279-45b7-bebf-711e9ced519e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:34:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6bc832b9-7e44-44e9-8aaa-f3de987bd068 req-89dcd4a1-d966-4954-8e20-d0954dc5aa2a service nova] Acquired lock "refresh_cache-e6c9e803-0279-45b7-bebf-711e9ced519e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:34:17 user nova-compute[75113]: DEBUG nova.network.neutron [req-6bc832b9-7e44-44e9-8aaa-f3de987bd068 req-89dcd4a1-d966-4954-8e20-d0954dc5aa2a service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Refreshing network info cache for port 109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:34:18 user nova-compute[75113]: DEBUG nova.network.neutron [req-6bc832b9-7e44-44e9-8aaa-f3de987bd068 req-89dcd4a1-d966-4954-8e20-d0954dc5aa2a service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Updated VIF entry in instance network info cache for port 109fd32f-8607-472d-b174-3c2a1b080858. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:34:18 user nova-compute[75113]: DEBUG nova.network.neutron [req-6bc832b9-7e44-44e9-8aaa-f3de987bd068 req-89dcd4a1-d966-4954-8e20-d0954dc5aa2a service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Updating instance_info_cache with network_info: [{"id": "109fd32f-8607-472d-b174-3c2a1b080858", "address": "fa:16:3e:98:bf:ed", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109fd32f-86", "ovs_interfaceid": "109fd32f-8607-472d-b174-3c2a1b080858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:34:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-6bc832b9-7e44-44e9-8aaa-f3de987bd068 req-89dcd4a1-d966-4954-8e20-d0954dc5aa2a service nova] Releasing lock "refresh_cache-e6c9e803-0279-45b7-bebf-711e9ced519e" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:34:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:34:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:34:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:34:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:34:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:34:19 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:34:19 user nova-compute[75113]: INFO nova.compute.claims [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Claim successful on node user
Oct 26 17:34:20 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG nova.network.neutron [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:34:20 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:34:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG nova.policy [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81bf8ffc2a3746ad9f895d7c2118e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf93275d83e4eeeb9f8d1dc96d6e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:34:20 user nova-compute[75113]: INFO nova.virt.block_device [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Booting with volume 3db5d223-edcb-43da-8584-1a1157f78b3a at /dev/vda
Oct 26 17:34:20 user nova-compute[75113]: DEBUG os_brick.utils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6632a1f5-e425-466a-a02f-98b254c23d60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69f2d1a-b048-4f55-ae80-b35384cb211c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a507c57-9543-4961-a077-d205ce14550c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f61ced2-21db-4601-b12e-aa8b9f46e18a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:34:20 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:34:20 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f983bec-b536-4c4d-a70c-1c7f64ede879]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG os_brick.utils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:34:20 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Updating existing volume attachment record: 3c92b13b-b772-4d3b-b538-02ac0dce44df {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:34:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Successfully created port: bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:34:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Successfully updated port: bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:34:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:34:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquired lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:34:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:34:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-e15e0957-75b7-4877-95f2-b732f7629f85 req-7abcb029-28ac-4e4a-8c66-42a8f37188af service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received event network-changed-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:34:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-e15e0957-75b7-4877-95f2-b732f7629f85 req-7abcb029-28ac-4e4a-8c66-42a8f37188af service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Refreshing instance network info cache due to event network-changed-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:34:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e15e0957-75b7-4877-95f2-b732f7629f85 req-7abcb029-28ac-4e4a-8c66-42a8f37188af service nova] Acquiring lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:34:21 user nova-compute[75113]: DEBUG nova.network.neutron [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:34:22 user nova-compute[75113]: DEBUG nova.network.neutron [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Updating instance_info_cache with network_info: [{"id": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "address": "fa:16:3e:11:12:5d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb3c4b9c-c5", "ovs_interfaceid": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:34:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Releasing lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:34:22 user nova-compute[75113]: DEBUG nova.compute.manager [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Instance network_info: |[{"id": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "address": "fa:16:3e:11:12:5d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb3c4b9c-c5", "ovs_interfaceid": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:34:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e15e0957-75b7-4877-95f2-b732f7629f85 req-7abcb029-28ac-4e4a-8c66-42a8f37188af service nova] Acquired lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:34:22 user nova-compute[75113]: DEBUG nova.network.neutron [req-e15e0957-75b7-4877-95f2-b732f7629f85 req-7abcb029-28ac-4e4a-8c66-42a8f37188af service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Refreshing network info cache for port bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:34:22 user nova-compute[75113]: DEBUG nova.network.neutron [req-e15e0957-75b7-4877-95f2-b732f7629f85 req-7abcb029-28ac-4e4a-8c66-42a8f37188af service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Updated VIF entry in instance network info cache for port bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:34:22 user nova-compute[75113]: DEBUG nova.network.neutron [req-e15e0957-75b7-4877-95f2-b732f7629f85 req-7abcb029-28ac-4e4a-8c66-42a8f37188af service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Updating instance_info_cache with network_info: [{"id": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "address": "fa:16:3e:11:12:5d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb3c4b9c-c5", "ovs_interfaceid": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:34:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-e15e0957-75b7-4877-95f2-b732f7629f85 req-7abcb029-28ac-4e4a-8c66-42a8f37188af service nova] Releasing lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:34:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "e6c9e803-0279-45b7-bebf-711e9ced519e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG nova.objects.instance [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'flavor' on Instance uuid e6c9e803-0279-45b7-bebf-711e9ced519e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "e6c9e803-0279-45b7-bebf-711e9ced519e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:34:23 user nova-compute[75113]: INFO nova.compute.manager [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Attaching volume 4f243ff8-c83a-4d6b-9652-0681023de5f8 to /dev/vdb
Oct 26 17:34:23 user nova-compute[75113]: DEBUG os_brick.utils [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d870dc-79e3-4001-925f-d78dbd9fc2fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c3cb9d-daf9-434e-a6bf-e5f8d6aab2c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[11190d14-a22d-4db7-9f3f-510bde90f304]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0142d28-3d03-4357-b8bd-c20d0dc494ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:34:23 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:34:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8146deea-7f82-49c9-9f37-3564ba09b519]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG os_brick.utils [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:34:23 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Updating existing volume attachment record: f698800a-1370-4960-abce-7d85c819a3b2 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:34:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:28 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:34:28 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:34:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:33 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:34:34 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:34:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:34:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:34:34 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:34:34 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:34:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:34 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:35 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:34:35 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:34:35 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8729MB free_disk=24.986740112304688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 97199d01-06b9-4e73-a23e-2b6110544afe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e6c9e803-0279-45b7-bebf-711e9ced519e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:34:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:34:38 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:34:38 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:34:38 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 17:34:38 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:34:38 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:34:38 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:34:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:49 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:34:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHOuUVLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:34:59 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:34:59 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:34:59 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[23faeef9-4e30-471c-925d-bdcc329de34d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:34:59 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[33afa2ee-1342-4268-bd45-1834c76e69e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8] added
Oct 26 17:34:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9789b3ec-c562-498a-9d7e-cd5a05bef56a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[39695823-cde6-4351-93e4-a7ba3de766af]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHOuUVLc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHOuUVLc" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9e89f3-8ae7-4a14-be08-dd0e967a9e68]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tHOuUVLc'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[01653006-19bf-48f5-a0e9-57a63c714dda]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebdae20-c861-4c10-84a4-213e7efc8945]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:34:59 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:34:59 user nova-compute[75113]:  {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:34:59 user nova-compute[75113]: WARNING os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 17:34:59 user nova-compute[75113]: 
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c83b50-8a0a-43d6-81f7-32e927bbccfe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:34:59 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8, portal: 172.16.0.220,3260]
Oct 26 17:34:59 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8, portal: 172.16.0.220,3260] successful.
Oct 26 17:34:59 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a403aea-8511-4483-bb25-264a3b152a14]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e3dc1f-4b07-4ac1-b461-0201246a1467]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 (non-flash)
Oct 26 17:35:00 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 (non-flash)
Oct 26 17:35:00 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.compute.manager [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:35:00 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Creating image(s)
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Ensure instance console log exists: /opt/stack/data/nova/instances/3eda4ed5-fb21-47bd-97e1-d6aa193ff27c/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Start _get_guest_xml network_info=[{"id": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "address": "fa:16:3e:11:12:5d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb3c4b9c-c5", "ovs_interfaceid": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3c92b13b-b772-4d3b-b538-02ac0dce44df', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgHkOcWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3eda4ed5-fb21-47bd-97e1-d6aa193ff27c', 'attached_at': '', 'detached_at': '', 'volume_id': '3db5d223-edcb-43da-8584-1a1157f78b3a', 'serial': '3db5d223-edcb-43da-8584-1a1157f78b3a'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a61f69-1f88-4317-8935-f13489ea8588]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHOuUVLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:35:00 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:35:00 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:35:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgHkOcWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:35:00 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:35:00 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23332613830393665', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332613830393665', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.955s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:35:01 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:35:01 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:35:01 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG nova.objects.instance [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'flavor' on Instance uuid e6c9e803-0279-45b7-bebf-711e9ced519e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bfb6ed-42c1-4420-8488-1c61f223884d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:35:01 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:35:01 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:35:01 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:35:01 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:35:01 user nova-compute[75113]:   <serial>4f243ff8-c83a-4d6b-9652-0681023de5f8</serial>
Oct 26 17:35:01 user nova-compute[75113]: </disk>
Oct 26 17:35:01 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[500b0e0d-3c48-4d1c-a104-bfbe977a7819]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a] added
Oct 26 17:35:01 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7db20e-fb2d-49b2-9ee2-dea7149bbd78]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda7c247-d7a9-4e3f-8457-842b176536d7]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CgHkOcWy {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CgHkOcWy" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[545727b6-cbb5-40aa-8c95-4eef94aaa1b7]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CgHkOcWy'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[420bb218-cdbd-42e3-934f-1f990ce4b80c]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6bc32b-7053-4ade-b6fc-36c77ca9893f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 (non-flash)
Oct 26 17:35:01 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 (non-flash)
Oct 26 17:35:01 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No VIF found with MAC fa:16:3e:98:bf:ed, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:35:01 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-27f54ad2-ef56-405e-b23f-15481676e403 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.863s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --login" returned: 0 in 1.052s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8008bb-bde2-45dd-a42d-f51f2e0c6c71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a, portal: 172.16.0.220,3260]
Oct 26 17:35:02 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a, portal: 172.16.0.220,3260] successful.
Oct 26 17:35:02 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb47936-d00d-4639-a0b2-69aba1422b5d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34480396-c573-4070-9a94-05acbfb8de0a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 (non-flash)
Oct 26 17:35:02 user nova-compute[75113]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:35:02 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 (non-flash)
Oct 26 17:35:02 user nova-compute[75113]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:35:02 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.270s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[224f805e-bd93-49fc-bbf3-3a5863a069ce]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "e6c9e803-0279-45b7-bebf-711e9ced519e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:02 user nova-compute[75113]: INFO nova.compute.manager [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Detaching volume 4f243ff8-c83a-4d6b-9652-0681023de5f8
Oct 26 17:35:02 user nova-compute[75113]: INFO nova.virt.block_device [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Attempting to driver detach volume 4f243ff8-c83a-4d6b-9652-0681023de5f8 from mountpoint /dev/vdb
Oct 26 17:35:02 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Attempting to detach device vdb from instance e6c9e803-0279-45b7-bebf-711e9ced519e from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:35:02 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:35:02 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:35:02 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:35:02 user nova-compute[75113]:   <serial>4f243ff8-c83a-4d6b-9652-0681023de5f8</serial>
Oct 26 17:35:02 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:35:02 user nova-compute[75113]: </disk>
Oct 26 17:35:02 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:35:02 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully detached device vdb from instance e6c9e803-0279-45b7-bebf-711e9ced519e from the persistent domain config.
Oct 26 17:35:02 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6c9e803-0279-45b7-bebf-711e9ced519e from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:35:02 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:35:02 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:35:02 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:35:02 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:35:02 user nova-compute[75113]:   <serial>4f243ff8-c83a-4d6b-9652-0681023de5f8</serial>
Oct 26 17:35:02 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:35:02 user nova-compute[75113]: </disk>
Oct 26 17:35:02 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6c9e803-0279-45b7-bebf-711e9ced519e {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgHkOcWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.299s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== connect_volume: return (3254ms) {'type': 'block', 'scsi_wwn': '23633393066383563', 'path': '/dev/sdc'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633393066383563', 'path': '/dev/sdc'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:34:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2042664630',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2042664630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2042664630',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPg98b8+niy8MgKhwt9jZ8IbMdWaBUwi/OKEDDG5hWGG+OMPBVBvJs1CUYZcdI+2JkiPWhm6E1SI4xIgJHrkBTdp+eNb3oPKFaMqb53R/4H3MrJI2vCfOmF+UJ2s3HbaA==',key_name='tempest-keypair-1260591920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-6ejvn600',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:34:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=3eda4ed5-fb21-47bd-97e1-d6aa193ff27c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "address": "fa:16:3e:11:12:5d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb3c4b9c-c5", "ovs_interfaceid": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "address": "fa:16:3e:11:12:5d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb3c4b9c-c5", "ovs_interfaceid": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb3c4b9c-c5') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG nova.objects.instance [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lazy-loading 'pci_devices' on Instance uuid 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:35:03 user nova-compute[75113]:   <uuid>3eda4ed5-fb21-47bd-97e1-d6aa193ff27c</uuid>
Oct 26 17:35:03 user nova-compute[75113]:   <name>instance-0000002f</name>
Oct 26 17:35:03 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:35:03 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:35:03 user nova-compute[75113]:   <metadata>
Oct 26 17:35:03 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:35:03 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:35:03 user nova-compute[75113]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2042664630</nova:name>
Oct 26 17:35:03 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:35:00</nova:creationTime>
Oct 26 17:35:03 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:35:03 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:35:03 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:35:03 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:35:03 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:35:03 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:35:03 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:35:03 user nova-compute[75113]:       <nova:owner>
Oct 26 17:35:03 user nova-compute[75113]:         <nova:user uuid="81bf8ffc2a3746ad9f895d7c2118e33a">tempest-TestVolumeBootPattern-27660292-project-member</nova:user>
Oct 26 17:35:03 user nova-compute[75113]:         <nova:project uuid="9bf93275d83e4eeeb9f8d1dc96d6e7f8">tempest-TestVolumeBootPattern-27660292</nova:project>
Oct 26 17:35:03 user nova-compute[75113]:       </nova:owner>
Oct 26 17:35:03 user nova-compute[75113]:       <nova:ports>
Oct 26 17:35:03 user nova-compute[75113]:         <nova:port uuid="bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff">
Oct 26 17:35:03 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 17:35:03 user nova-compute[75113]:         </nova:port>
Oct 26 17:35:03 user nova-compute[75113]:       </nova:ports>
Oct 26 17:35:03 user nova-compute[75113]:     </nova:instance>
Oct 26 17:35:03 user nova-compute[75113]:   </metadata>
Oct 26 17:35:03 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:35:03 user nova-compute[75113]:     <system>
Oct 26 17:35:03 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:35:03 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:35:03 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:35:03 user nova-compute[75113]:       <entry name="serial">3eda4ed5-fb21-47bd-97e1-d6aa193ff27c</entry>
Oct 26 17:35:03 user nova-compute[75113]:       <entry name="uuid">3eda4ed5-fb21-47bd-97e1-d6aa193ff27c</entry>
Oct 26 17:35:03 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:35:03 user nova-compute[75113]:     </system>
Oct 26 17:35:03 user nova-compute[75113]:   </sysinfo>
Oct 26 17:35:03 user nova-compute[75113]:   <os>
Oct 26 17:35:03 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:35:03 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:35:03 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:35:03 user nova-compute[75113]:   </os>
Oct 26 17:35:03 user nova-compute[75113]:   <features>
Oct 26 17:35:03 user nova-compute[75113]:     <acpi/>
Oct 26 17:35:03 user nova-compute[75113]:     <apic/>
Oct 26 17:35:03 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:35:03 user nova-compute[75113]:   </features>
Oct 26 17:35:03 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:35:03 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:35:03 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:35:03 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:35:03 user nova-compute[75113]:   </clock>
Oct 26 17:35:03 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:35:03 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:35:03 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:35:03 user nova-compute[75113]:   </cpu>
Oct 26 17:35:03 user nova-compute[75113]:   <devices>
Oct 26 17:35:03 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:35:03 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:35:03 user nova-compute[75113]:       <source dev="/dev/sdc"/>
Oct 26 17:35:03 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:35:03 user nova-compute[75113]:       <serial>3db5d223-edcb-43da-8584-1a1157f78b3a</serial>
Oct 26 17:35:03 user nova-compute[75113]:     </disk>
Oct 26 17:35:03 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:35:03 user nova-compute[75113]:       <mac address="fa:16:3e:11:12:5d"/>
Oct 26 17:35:03 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:35:03 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:35:03 user nova-compute[75113]:       <target dev="tapbb3c4b9c-c5"/>
Oct 26 17:35:03 user nova-compute[75113]:     </interface>
Oct 26 17:35:03 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:35:03 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/3eda4ed5-fb21-47bd-97e1-d6aa193ff27c/console.log" append="off"/>
Oct 26 17:35:03 user nova-compute[75113]:     </serial>
Oct 26 17:35:03 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:35:03 user nova-compute[75113]:     <video>
Oct 26 17:35:03 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:35:03 user nova-compute[75113]:     </video>
Oct 26 17:35:03 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:35:03 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:35:03 user nova-compute[75113]:     </rng>
Oct 26 17:35:03 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:35:03 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:35:03 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:35:03 user nova-compute[75113]:     </memballoon>
Oct 26 17:35:03 user nova-compute[75113]:   </devices>
Oct 26 17:35:03 user nova-compute[75113]: </domain>
Oct 26 17:35:03 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:34:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2042664630',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2042664630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2042664630',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPg98b8+niy8MgKhwt9jZ8IbMdWaBUwi/OKEDDG5hWGG+OMPBVBvJs1CUYZcdI+2JkiPWhm6E1SI4xIgJHrkBTdp+eNb3oPKFaMqb53R/4H3MrJI2vCfOmF+UJ2s3HbaA==',key_name='tempest-keypair-1260591920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-6ejvn600',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:34:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=3eda4ed5-fb21-47bd-97e1-d6aa193ff27c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "address": "fa:16:3e:11:12:5d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb3c4b9c-c5", "ovs_interfaceid": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "address": "fa:16:3e:11:12:5d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb3c4b9c-c5", "ovs_interfaceid": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb3c4b9c-c5') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG os_vif [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb3c4b9c-c5') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b80cef1-e838-52db-90ae-1a1046da0fbb', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb3c4b9c-c5, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb3c4b9c-c5, col_values=(('qos', UUID('0a65eab1-aa60-4406-a736-9e5e089a8620')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb3c4b9c-c5, col_values=(('external_ids', {'iface-id': 'bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:12:5d', 'vm-uuid': '3eda4ed5-fb21-47bd-97e1-d6aa193ff27c'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:03 user nova-compute[75113]: INFO os_vif [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb3c4b9c-c5')
Oct 26 17:35:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:35:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] No VIF found with MAC fa:16:3e:11:12:5d, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:35:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-f66fed17-e758-42dc-bba0-dee799a0a389 req-90daeb32-f1da-4c21-a083-1ff5562a409d service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received event network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:35:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f66fed17-e758-42dc-bba0-dee799a0a389 req-90daeb32-f1da-4c21-a083-1ff5562a409d service nova] Acquiring lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f66fed17-e758-42dc-bba0-dee799a0a389 req-90daeb32-f1da-4c21-a083-1ff5562a409d service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:04 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f66fed17-e758-42dc-bba0-dee799a0a389 req-90daeb32-f1da-4c21-a083-1ff5562a409d service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:04 user nova-compute[75113]: DEBUG nova.compute.manager [req-f66fed17-e758-42dc-bba0-dee799a0a389 req-90daeb32-f1da-4c21-a083-1ff5562a409d service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] No waiting events found dispatching network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:35:04 user nova-compute[75113]: WARNING nova.compute.manager [req-f66fed17-e758-42dc-bba0-dee799a0a389 req-90daeb32-f1da-4c21-a083-1ff5562a409d service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received unexpected event network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff for instance with vm_state building and task_state spawning.
Oct 26 17:35:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:05 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:06 user nova-compute[75113]: DEBUG nova.compute.manager [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:35:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:35:06 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Instance spawned successfully.
Oct 26 17:35:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:35:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:35:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:35:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:35:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:35:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:35:06 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:35:06 user nova-compute[75113]: INFO nova.compute.manager [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Took 6.82 seconds to spawn the instance on the hypervisor.
Oct 26 17:35:06 user nova-compute[75113]: DEBUG nova.compute.manager [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:35:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-9d710e33-75ba-40c8-9ae2-2dbde556cd4b req-8bc6e43a-ad35-460e-9916-c0703da5a964 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received event network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:35:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9d710e33-75ba-40c8-9ae2-2dbde556cd4b req-8bc6e43a-ad35-460e-9916-c0703da5a964 service nova] Acquiring lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9d710e33-75ba-40c8-9ae2-2dbde556cd4b req-8bc6e43a-ad35-460e-9916-c0703da5a964 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9d710e33-75ba-40c8-9ae2-2dbde556cd4b req-8bc6e43a-ad35-460e-9916-c0703da5a964 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-9d710e33-75ba-40c8-9ae2-2dbde556cd4b req-8bc6e43a-ad35-460e-9916-c0703da5a964 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] No waiting events found dispatching network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:35:06 user nova-compute[75113]: WARNING nova.compute.manager [req-9d710e33-75ba-40c8-9ae2-2dbde556cd4b req-8bc6e43a-ad35-460e-9916-c0703da5a964 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received unexpected event network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff for instance with vm_state building and task_state spawning.
Oct 26 17:35:06 user nova-compute[75113]: INFO nova.compute.manager [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Took 47.15 seconds to build instance.
Oct 26 17:35:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-959bb869-3006-4015-9863-0c1c747975f8 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.266s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:35:23 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e6c9e803-0279-45b7-bebf-711e9ced519e is timed out.
Oct 26 17:35:23 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully detached device vdb from instance e6c9e803-0279-45b7-bebf-711e9ced519e from the live domain config.
Oct 26 17:35:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHOuUVLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:35:23 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d489c8-06bb-44b6-bbfc-286e04305dea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:35:23 user nova-compute[75113]: No targets found.
Oct 26 17:35:23 user nova-compute[75113]: iSNS:
Oct 26 17:35:23 user nova-compute[75113]: No targets found.
Oct 26 17:35:23 user nova-compute[75113]: STATIC:
Oct 26 17:35:23 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a
Oct 26 17:35:23 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:35:23 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:35:23 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8
Oct 26 17:35:23 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:35:23 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:35:23 user nova-compute[75113]: FIRMWARE:
Oct 26 17:35:23 user nova-compute[75113]: No targets found.
Oct 26 17:35:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:35:23 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:35:23 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd12285-a9b6-4117-b3c1-63c3ced61ca0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3a29cf-4435-4849-be65-e246756e52b8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 (non-flash)
Oct 26 17:35:23 user nova-compute[75113]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:35:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 (non-flash)
Oct 26 17:35:23 user nova-compute[75113]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:35:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914363490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c278c67c-4891-4db7-b0aa-69c61d987217]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d474197-0e58-4771-903e-49446976d928]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[553e486e-dccc-4a40-9c84-736649e183d5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac949d0b-5a27-40ac-92a3-fac1d1f216d8]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7c99d1-419e-4147-b397-6962f21ca928]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0655475-e392-449c-b8d6-8755b6bfabce]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8, portal: 172.16.0.220,3260]
Oct 26 17:35:23 user nova-compute[75113]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8, portal: 172.16.0.220,3260] successful.
Oct 26 17:35:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f243ff8-c83a-4d6b-9652-0681023de5f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[082f0417-b975-4901-ac3a-e4b92afc4557]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] <== disconnect_volume: return (320ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:35:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:35:24 user nova-compute[75113]: DEBUG nova.objects.instance [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'flavor' on Instance uuid e6c9e803-0279-45b7-bebf-711e9ced519e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:35:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-d05dc88a-6032-4832-a75c-50ad8d03aa3b tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.807s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:30 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:35:30 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:35:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:34 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:35:35 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:35:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:35 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:35 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:35:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:35 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:35:36 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:35:36 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:35:36 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:35:36 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:35:36 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8587MB free_disk=24.975791931152344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:35:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:36 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 97199d01-06b9-4e73-a23e-2b6110544afe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:35:36 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance e6c9e803-0279-45b7-bebf-711e9ced519e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:35:36 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:35:36 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:35:36 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:35:37 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:35:37 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:35:37 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:35:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:40 user nova-compute[75113]: INFO nova.compute.manager [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Terminating instance
Oct 26 17:35:40 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG nova.compute.manager [req-fc97950b-3ef1-4b0d-ab93-163e4a3d311f req-94563319-7b95-4e0f-bb7a-3ccde0ab41bf service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Received event network-vif-unplugged-2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fc97950b-3ef1-4b0d-ab93-163e4a3d311f req-94563319-7b95-4e0f-bb7a-3ccde0ab41bf service nova] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fc97950b-3ef1-4b0d-ab93-163e4a3d311f req-94563319-7b95-4e0f-bb7a-3ccde0ab41bf service nova] Lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-fc97950b-3ef1-4b0d-ab93-163e4a3d311f req-94563319-7b95-4e0f-bb7a-3ccde0ab41bf service nova] Lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG nova.compute.manager [req-fc97950b-3ef1-4b0d-ab93-163e4a3d311f req-94563319-7b95-4e0f-bb7a-3ccde0ab41bf service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] No waiting events found dispatching network-vif-unplugged-2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG nova.compute.manager [req-fc97950b-3ef1-4b0d-ab93-163e4a3d311f req-94563319-7b95-4e0f-bb7a-3ccde0ab41bf service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Received event network-vif-unplugged-2cb265c0-d6bd-45df-8f3f-644e528b3649 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updating instance_info_cache with network_info: [{"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-97199d01-06b9-4e73-a23e-2b6110544afe" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:35:40 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:35:41 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Instance destroyed successfully.
Oct 26 17:35:41 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lazy-loading 'resources' on Instance uuid 97199d01-06b9-4e73-a23e-2b6110544afe {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1518380257',display_name='tempest-SnapshotDataIntegrityTests-server-1518380257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1518380257',id=42,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM72a5iswLF9qRkPAQTKu+MlJ8Lo+VmfOB/9nwYs170yTm6gViovtBCEp4YEzt5mkqZbS1/6RItme//svyMYKKg2oj153HpIWwDEs7xEJmJL6I4UUvhXEC2WcNE6/mqpw==',key_name='tempest-keypair-923807152',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:26:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94fd3b9d04974136a73ca94037077ee0',ramdisk_id='',reservation_id='r-95dpv00i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1837637180',owner_user_name='tempest-SnapshotDataIntegrityTests-1837637180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c328bc794cde4ee1b1f2b210503317af',uuid=97199d01-06b9-4e73-a23e-2b6110544afe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Converting VIF {"id": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "address": "fa:16:3e:5f:9f:36", "network": {"id": "481d2d50-98a1-4c31-adbe-e282f5b40f73", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28018469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94fd3b9d04974136a73ca94037077ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb265c0-d6", "ovs_interfaceid": "2cb265c0-d6bd-45df-8f3f-644e528b3649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9f:36,bridge_name='br-int',has_traffic_filtering=True,id=2cb265c0-d6bd-45df-8f3f-644e528b3649,network=Network(481d2d50-98a1-4c31-adbe-e282f5b40f73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb265c0-d6') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG os_vif [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9f:36,bridge_name='br-int',has_traffic_filtering=True,id=2cb265c0-d6bd-45df-8f3f-644e528b3649,network=Network(481d2d50-98a1-4c31-adbe-e282f5b40f73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb265c0-d6') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cb265c0-d6, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47c7a321-5435-4236-ba3e-9fd33b1f2622) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:35:41 user nova-compute[75113]: INFO os_vif [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9f:36,bridge_name='br-int',has_traffic_filtering=True,id=2cb265c0-d6bd-45df-8f3f-644e528b3649,network=Network(481d2d50-98a1-4c31-adbe-e282f5b40f73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb265c0-d6')
Oct 26 17:35:41 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Deleting instance files /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe_del
Oct 26 17:35:41 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Deletion of /opt/stack/data/nova/instances/97199d01-06b9-4e73-a23e-2b6110544afe_del complete
Oct 26 17:35:41 user nova-compute[75113]: INFO nova.compute.manager [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 17:35:41 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:35:41 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Took 0.72 seconds to deallocate network for instance.
Oct 26 17:35:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-9c0cc7be-8349-460a-8f4f-c718b4a889b7 req-4cfd5a3b-f61f-4c07-9d61-3315958991d5 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Received event network-vif-deleted-2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:35:41 user nova-compute[75113]: INFO nova.compute.manager [req-9c0cc7be-8349-460a-8f4f-c718b4a889b7 req-4cfd5a3b-f61f-4c07-9d61-3315958991d5 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Neutron deleted interface 2cb265c0-d6bd-45df-8f3f-644e528b3649; detaching it from the instance and deleting it from the info cache
Oct 26 17:35:41 user nova-compute[75113]: DEBUG nova.network.neutron [req-9c0cc7be-8349-460a-8f4f-c718b4a889b7 req-4cfd5a3b-f61f-4c07-9d61-3315958991d5 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:35:41 user nova-compute[75113]: DEBUG nova.compute.manager [req-9c0cc7be-8349-460a-8f4f-c718b4a889b7 req-4cfd5a3b-f61f-4c07-9d61-3315958991d5 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Detach interface failed, port_id=2cb265c0-d6bd-45df-8f3f-644e528b3649, reason: Instance 97199d01-06b9-4e73-a23e-2b6110544afe could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:35:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:42 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:35:42 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:35:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:42 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Deleted allocations for instance 97199d01-06b9-4e73-a23e-2b6110544afe
Oct 26 17:35:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2c9c332a-2ff8-468a-9fb6-8dbab277628c tempest-SnapshotDataIntegrityTests-1837637180 tempest-SnapshotDataIntegrityTests-1837637180-project-member] Lock "97199d01-06b9-4e73-a23e-2b6110544afe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.062s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:42 user nova-compute[75113]: DEBUG nova.compute.manager [req-2e8c00f1-b389-465a-b266-0b90826180c1 req-50a16097-3143-4953-a586-ead6bce4d6f4 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Received event network-vif-plugged-2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:35:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2e8c00f1-b389-465a-b266-0b90826180c1 req-50a16097-3143-4953-a586-ead6bce4d6f4 service nova] Acquiring lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2e8c00f1-b389-465a-b266-0b90826180c1 req-50a16097-3143-4953-a586-ead6bce4d6f4 service nova] Lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-2e8c00f1-b389-465a-b266-0b90826180c1 req-50a16097-3143-4953-a586-ead6bce4d6f4 service nova] Lock "97199d01-06b9-4e73-a23e-2b6110544afe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:42 user nova-compute[75113]: DEBUG nova.compute.manager [req-2e8c00f1-b389-465a-b266-0b90826180c1 req-50a16097-3143-4953-a586-ead6bce4d6f4 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] No waiting events found dispatching network-vif-plugged-2cb265c0-d6bd-45df-8f3f-644e528b3649 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:35:42 user nova-compute[75113]: WARNING nova.compute.manager [req-2e8c00f1-b389-465a-b266-0b90826180c1 req-50a16097-3143-4953-a586-ead6bce4d6f4 service nova] [instance: 97199d01-06b9-4e73-a23e-2b6110544afe] Received unexpected event network-vif-plugged-2cb265c0-d6bd-45df-8f3f-644e528b3649 for instance with vm_state deleted and task_state None.
Oct 26 17:35:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:48 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:35:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 17:35:50 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:35:50 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:35:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "e6c9e803-0279-45b7-bebf-711e9ced519e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:53 user nova-compute[75113]: INFO nova.compute.manager [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Terminating instance
Oct 26 17:35:53 user nova-compute[75113]: DEBUG nova.compute.manager [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-39fae54b-edbd-4d52-a437-f56e6d3f5570 req-def80d5f-99b2-4d34-9ae1-6e2b7067d534 service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Received event network-vif-unplugged-109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-39fae54b-edbd-4d52-a437-f56e6d3f5570 req-def80d5f-99b2-4d34-9ae1-6e2b7067d534 service nova] Acquiring lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-39fae54b-edbd-4d52-a437-f56e6d3f5570 req-def80d5f-99b2-4d34-9ae1-6e2b7067d534 service nova] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-39fae54b-edbd-4d52-a437-f56e6d3f5570 req-def80d5f-99b2-4d34-9ae1-6e2b7067d534 service nova] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-39fae54b-edbd-4d52-a437-f56e6d3f5570 req-def80d5f-99b2-4d34-9ae1-6e2b7067d534 service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] No waiting events found dispatching network-vif-unplugged-109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-39fae54b-edbd-4d52-a437-f56e6d3f5570 req-def80d5f-99b2-4d34-9ae1-6e2b7067d534 service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Received event network-vif-unplugged-109fd32f-8607-472d-b174-3c2a1b080858 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:35:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:54 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Instance destroyed successfully.
Oct 26 17:35:54 user nova-compute[75113]: DEBUG nova.objects.instance [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'resources' on Instance uuid e6c9e803-0279-45b7-bebf-711e9ced519e {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1494941515',display_name='tempest-AttachVolumeNegativeTest-server-1494941515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1494941515',id=46,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/DkEG0wwiSBA6oPzZo//upnl+HdqNdHZolS6Nik4I/KkBUiWNZyu06txQPab4qLKIxnPOwHf2IR2gFI7tffJB2QueQdtfcDzK/F6UGe+dL2ueZNRvnQZwJThRjr0DVJA==',key_name='tempest-keypair-1913146126',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:32:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c30bd0e84d1448158ca783491ed372f5',ramdisk_id='',reservation_id='r-6ge7us1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1111816565',owner_user_name='tempest-AttachVolumeNegativeTest-1111816565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:32:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47bb03390d7d489d91750653f399125f',uuid=e6c9e803-0279-45b7-bebf-711e9ced519e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "109fd32f-8607-472d-b174-3c2a1b080858", "address": "fa:16:3e:98:bf:ed", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109fd32f-86", "ovs_interfaceid": "109fd32f-8607-472d-b174-3c2a1b080858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converting VIF {"id": "109fd32f-8607-472d-b174-3c2a1b080858", "address": "fa:16:3e:98:bf:ed", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109fd32f-86", "ovs_interfaceid": "109fd32f-8607-472d-b174-3c2a1b080858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:bf:ed,bridge_name='br-int',has_traffic_filtering=True,id=109fd32f-8607-472d-b174-3c2a1b080858,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109fd32f-86') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG os_vif [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:bf:ed,bridge_name='br-int',has_traffic_filtering=True,id=109fd32f-8607-472d-b174-3c2a1b080858,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109fd32f-86') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap109fd32f-86, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14b20427-088f-4ccb-85da-8cdec9c3fc88) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:35:54 user nova-compute[75113]: INFO os_vif [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:bf:ed,bridge_name='br-int',has_traffic_filtering=True,id=109fd32f-8607-472d-b174-3c2a1b080858,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109fd32f-86')
Oct 26 17:35:54 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Deleting instance files /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e_del
Oct 26 17:35:54 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Deletion of /opt/stack/data/nova/instances/e6c9e803-0279-45b7-bebf-711e9ced519e_del complete
Oct 26 17:35:54 user nova-compute[75113]: INFO nova.compute.manager [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 26 17:35:54 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:35:54 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:35:55 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:35:55 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Took 1.00 seconds to deallocate network for instance.
Oct 26 17:35:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-acbba26b-d54c-4083-8fb8-4f6b12cfb2ed req-d9abffca-58eb-49e3-a241-641c14c7efc1 service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Received event network-vif-deleted-109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:35:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:55 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:35:55 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:35:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:55 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Deleted allocations for instance e6c9e803-0279-45b7-bebf-711e9ced519e
Oct 26 17:35:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-58bce3f4-22c1-4b50-a09f-33bb9048b017 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.250s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7ccc1d6-cce3-4459-b124-fa98b2ae2047 req-f56f7416-ffcc-4716-9e30-71a5d76e269e service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Received event network-vif-plugged-109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:35:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7ccc1d6-cce3-4459-b124-fa98b2ae2047 req-f56f7416-ffcc-4716-9e30-71a5d76e269e service nova] Acquiring lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:35:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7ccc1d6-cce3-4459-b124-fa98b2ae2047 req-f56f7416-ffcc-4716-9e30-71a5d76e269e service nova] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:35:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-d7ccc1d6-cce3-4459-b124-fa98b2ae2047 req-f56f7416-ffcc-4716-9e30-71a5d76e269e service nova] Lock "e6c9e803-0279-45b7-bebf-711e9ced519e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:35:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-d7ccc1d6-cce3-4459-b124-fa98b2ae2047 req-f56f7416-ffcc-4716-9e30-71a5d76e269e service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] No waiting events found dispatching network-vif-plugged-109fd32f-8607-472d-b174-3c2a1b080858 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:35:55 user nova-compute[75113]: WARNING nova.compute.manager [req-d7ccc1d6-cce3-4459-b124-fa98b2ae2047 req-f56f7416-ffcc-4716-9e30-71a5d76e269e service nova] [instance: e6c9e803-0279-45b7-bebf-711e9ced519e] Received unexpected event network-vif-plugged-109fd32f-8607-472d-b174-3c2a1b080858 for instance with vm_state deleted and task_state None.
Oct 26 17:35:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:36:03 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 17:36:03 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] There are 0 instances to clean {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 17:36:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:36:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:36:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:36:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:36:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-cfcae5f7-0721-47ee-9b16-a3230d695272 req-12865d47-c415-4dcb-bdab-00815d2c1202 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received event network-changed-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:36:10 user nova-compute[75113]: DEBUG nova.compute.manager [req-cfcae5f7-0721-47ee-9b16-a3230d695272 req-12865d47-c415-4dcb-bdab-00815d2c1202 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Refreshing instance network info cache due to event network-changed-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:36:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cfcae5f7-0721-47ee-9b16-a3230d695272 req-12865d47-c415-4dcb-bdab-00815d2c1202 service nova] Acquiring lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:36:10 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cfcae5f7-0721-47ee-9b16-a3230d695272 req-12865d47-c415-4dcb-bdab-00815d2c1202 service nova] Acquired lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:36:10 user nova-compute[75113]: DEBUG nova.network.neutron [req-cfcae5f7-0721-47ee-9b16-a3230d695272 req-12865d47-c415-4dcb-bdab-00815d2c1202 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Refreshing network info cache for port bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:36:11 user nova-compute[75113]: DEBUG nova.network.neutron [req-cfcae5f7-0721-47ee-9b16-a3230d695272 req-12865d47-c415-4dcb-bdab-00815d2c1202 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Updated VIF entry in instance network info cache for port bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:36:11 user nova-compute[75113]: DEBUG nova.network.neutron [req-cfcae5f7-0721-47ee-9b16-a3230d695272 req-12865d47-c415-4dcb-bdab-00815d2c1202 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Updating instance_info_cache with network_info: [{"id": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "address": "fa:16:3e:11:12:5d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb3c4b9c-c5", "ovs_interfaceid": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:36:11 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cfcae5f7-0721-47ee-9b16-a3230d695272 req-12865d47-c415-4dcb-bdab-00815d2c1202 service nova] Releasing lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:36:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:36:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:36:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:36:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:36:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:36:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "42a2fbed-6d09-43f2-940e-5a686b150ae8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:36:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:25 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:36:25 user nova-compute[75113]: INFO nova.compute.claims [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Claim successful on node user
Oct 26 17:36:25 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Refreshing inventories for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 17:36:25 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Updating ProviderTree inventory for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 17:36:25 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Updating inventory in ProviderTree for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 17:36:25 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Refreshing aggregate associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, aggregates: None {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 17:36:25 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Refreshing trait associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 17:36:25 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:36:25 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:36:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:36:25 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:36:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:36:25 user nova-compute[75113]: DEBUG nova.network.neutron [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:36:25 user nova-compute[75113]: DEBUG nova.compute.manager [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:36:25 user nova-compute[75113]: INFO nova.virt.block_device [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Booting with volume snapshot 0fb53e2e-233e-404a-b936-830b44410087 at /dev/vda
Oct 26 17:36:25 user nova-compute[75113]: DEBUG nova.policy [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81bf8ffc2a3746ad9f895d7c2118e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf93275d83e4eeeb9f8d1dc96d6e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:36:26 user nova-compute[75113]: DEBUG nova.network.neutron [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Successfully created port: 5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:36:26 user nova-compute[75113]: DEBUG nova.network.neutron [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Successfully updated port: 5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "refresh_cache-42a2fbed-6d09-43f2-940e-5a686b150ae8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquired lock "refresh_cache-42a2fbed-6d09-43f2-940e-5a686b150ae8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG nova.network.neutron [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-810b4eab-c08a-4c11-b302-77aaf2b910b1 req-d2601b57-d198-4e1c-8d69-ebb0372a9d9e service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Received event network-changed-5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG nova.compute.manager [req-810b4eab-c08a-4c11-b302-77aaf2b910b1 req-d2601b57-d198-4e1c-8d69-ebb0372a9d9e service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Refreshing instance network info cache due to event network-changed-5eebf416-d042-43d8-b5dd-11f92217cc87. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-810b4eab-c08a-4c11-b302-77aaf2b910b1 req-d2601b57-d198-4e1c-8d69-ebb0372a9d9e service nova] Acquiring lock "refresh_cache-42a2fbed-6d09-43f2-940e-5a686b150ae8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG nova.network.neutron [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG nova.network.neutron [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Updating instance_info_cache with network_info: [{"id": "5eebf416-d042-43d8-b5dd-11f92217cc87", "address": "fa:16:3e:db:eb:57", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eebf416-d0", "ovs_interfaceid": "5eebf416-d042-43d8-b5dd-11f92217cc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Releasing lock "refresh_cache-42a2fbed-6d09-43f2-940e-5a686b150ae8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG nova.compute.manager [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Instance network_info: |[{"id": "5eebf416-d042-43d8-b5dd-11f92217cc87", "address": "fa:16:3e:db:eb:57", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eebf416-d0", "ovs_interfaceid": "5eebf416-d042-43d8-b5dd-11f92217cc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-810b4eab-c08a-4c11-b302-77aaf2b910b1 req-d2601b57-d198-4e1c-8d69-ebb0372a9d9e service nova] Acquired lock "refresh_cache-42a2fbed-6d09-43f2-940e-5a686b150ae8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG nova.network.neutron [req-810b4eab-c08a-4c11-b302-77aaf2b910b1 req-d2601b57-d198-4e1c-8d69-ebb0372a9d9e service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Refreshing network info cache for port 5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG nova.network.neutron [req-810b4eab-c08a-4c11-b302-77aaf2b910b1 req-d2601b57-d198-4e1c-8d69-ebb0372a9d9e service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Updated VIF entry in instance network info cache for port 5eebf416-d042-43d8-b5dd-11f92217cc87. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG nova.network.neutron [req-810b4eab-c08a-4c11-b302-77aaf2b910b1 req-d2601b57-d198-4e1c-8d69-ebb0372a9d9e service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Updating instance_info_cache with network_info: [{"id": "5eebf416-d042-43d8-b5dd-11f92217cc87", "address": "fa:16:3e:db:eb:57", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eebf416-d0", "ovs_interfaceid": "5eebf416-d042-43d8-b5dd-11f92217cc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:36:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-810b4eab-c08a-4c11-b302-77aaf2b910b1 req-d2601b57-d198-4e1c-8d69-ebb0372a9d9e service nova] Releasing lock "refresh_cache-42a2fbed-6d09-43f2-940e-5a686b150ae8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:36:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG os_brick.utils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[971d0840-6345-4e78-a9e2-570a6996a2df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef9417b-57f5-4489-acd3-1bdfc6111800]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5acdc1-0399-4429-b0fa-92e5536f6191]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a1d1a5-a08c-4395-ad76-77d822700e78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:36:31 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:36:31 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ae320a-4861-44da-b574-035bb67f2de9]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG os_brick.utils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:36:31 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Updating existing volume attachment record: 47e70a75-ade9-41e8-93ee-0448ad47fdc8 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:36:32 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:36:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:34 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:36:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:37 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:36:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:37 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:36:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:36:37 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:36:37 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:36:37 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=25.028564453125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:36:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:37 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:36:37 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 42a2fbed-6d09-43f2-940e-5a686b150ae8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:36:37 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:36:37 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:36:38 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:36:38 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:36:38 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:36:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:39 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:36:39 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:36:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:39 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:36:39 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:36:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:36:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:36:39 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:36:39 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Updating instance_info_cache with network_info: [{"id": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "address": "fa:16:3e:11:12:5d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb3c4b9c-c5", "ovs_interfaceid": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:36:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:36:39 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:36:39 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:36:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:36:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:36:47 user nova-compute[75113]: INFO nova.compute.claims [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Claim successful on node user
Oct 26 17:36:47 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:36:47 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:36:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:36:48 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:36:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG nova.policy [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47bb03390d7d489d91750653f399125f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30bd0e84d1448158ca783491ed372f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:36:48 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Creating image(s)
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "/opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "/opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "/opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.200s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.200s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk 1073741824 {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0,backing_fmt=raw /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk 1073741824" returned: 0 in 0.049s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "6318fe8d16b7d7bc5624fe4c235f64008a1c35c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6318fe8d16b7d7bc5624fe4c235f64008a1c35c0 --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk. size=1073741824 {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:48 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Successfully created port: c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.disk.api [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Cannot resize image /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk to a smaller size. {{(pid=75113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Created local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Ensure instance console log exists: /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Successfully updated port: c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquired lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-7475658c-efbf-4401-865f-17cc29b9b4c6 req-7819a9e7-87d8-4c82-a71c-33183c6373cc service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Received event network-changed-c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.compute.manager [req-7475658c-efbf-4401-865f-17cc29b9b4c6 req-7819a9e7-87d8-4c82-a71c-33183c6373cc service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Refreshing instance network info cache due to event network-changed-c2fdebb9-6cfa-4140-aec5-28c464e550a5. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7475658c-efbf-4401-865f-17cc29b9b4c6 req-7819a9e7-87d8-4c82-a71c-33183c6373cc service nova] Acquiring lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Updating instance_info_cache with network_info: [{"id": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "address": "fa:16:3e:76:5f:56", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fdebb9-6c", "ovs_interfaceid": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Releasing lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Instance network_info: |[{"id": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "address": "fa:16:3e:76:5f:56", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fdebb9-6c", "ovs_interfaceid": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7475658c-efbf-4401-865f-17cc29b9b4c6 req-7819a9e7-87d8-4c82-a71c-33183c6373cc service nova] Acquired lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.network.neutron [req-7475658c-efbf-4401-865f-17cc29b9b4c6 req-7819a9e7-87d8-4c82-a71c-33183c6373cc service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Refreshing network info cache for port c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Start _get_guest_xml network_info=[{"id": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "address": "fa:16:3e:76:5f:56", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fdebb9-6c", "ovs_interfaceid": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '91603055-2c31-464d-bb00-ae160ab6e467'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:36:49 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:36:49 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:50:20Z,direct_url=<?>,disk_format='qcow2',id=91603055-2c31-464d-bb00-ae160ab6e467,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='314c50648df9400297d4a6a4d8aab9e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:36:49 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1686619424',display_name='tempest-AttachVolumeNegativeTest-server-1686619424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1686619424',id=49,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgi4Uy8LKyc6lQv+aApQnJKVCG9TCPr3nnRvDPISye0WXe7LSJSO9XvO9Wlwp3GI4DyRuLCUTeyU/Sw5ZCR99+x4RJWx9cqlTv1kT+5FO1WgJgb5mw04OmdF3eeEbVQjQ==',key_name='tempest-keypair-1636082607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30bd0e84d1448158ca783491ed372f5',ramdisk_id='',reservation_id='r-2i0h0acf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1111816565',owner_user_name='tempest-AttachVolumeNegativeTest-1111816565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47bb03390d7d489d91750653f399125f',uuid=786ed55e-75d7-4569-a87f-fd16d03f5c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "address": "fa:16:3e:76:5f:56", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fdebb9-6c", "ovs_interfaceid": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converting VIF {"id": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "address": "fa:16:3e:76:5f:56", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fdebb9-6c", "ovs_interfaceid": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=c2fdebb9-6cfa-4140-aec5-28c464e550a5,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fdebb9-6c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'pci_devices' on Instance uuid 786ed55e-75d7-4569-a87f-fd16d03f5c8d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:36:50 user nova-compute[75113]:   <uuid>786ed55e-75d7-4569-a87f-fd16d03f5c8d</uuid>
Oct 26 17:36:50 user nova-compute[75113]:   <name>instance-00000031</name>
Oct 26 17:36:50 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:36:50 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:36:50 user nova-compute[75113]:   <metadata>
Oct 26 17:36:50 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:36:50 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:36:50 user nova-compute[75113]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1686619424</nova:name>
Oct 26 17:36:50 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:36:49</nova:creationTime>
Oct 26 17:36:50 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:36:50 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:36:50 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:36:50 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:36:50 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:36:50 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:36:50 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:36:50 user nova-compute[75113]:       <nova:owner>
Oct 26 17:36:50 user nova-compute[75113]:         <nova:user uuid="47bb03390d7d489d91750653f399125f">tempest-AttachVolumeNegativeTest-1111816565-project-member</nova:user>
Oct 26 17:36:50 user nova-compute[75113]:         <nova:project uuid="c30bd0e84d1448158ca783491ed372f5">tempest-AttachVolumeNegativeTest-1111816565</nova:project>
Oct 26 17:36:50 user nova-compute[75113]:       </nova:owner>
Oct 26 17:36:50 user nova-compute[75113]:       <nova:root type="image" uuid="91603055-2c31-464d-bb00-ae160ab6e467"/>
Oct 26 17:36:50 user nova-compute[75113]:       <nova:ports>
Oct 26 17:36:50 user nova-compute[75113]:         <nova:port uuid="c2fdebb9-6cfa-4140-aec5-28c464e550a5">
Oct 26 17:36:50 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 17:36:50 user nova-compute[75113]:         </nova:port>
Oct 26 17:36:50 user nova-compute[75113]:       </nova:ports>
Oct 26 17:36:50 user nova-compute[75113]:     </nova:instance>
Oct 26 17:36:50 user nova-compute[75113]:   </metadata>
Oct 26 17:36:50 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:36:50 user nova-compute[75113]:     <system>
Oct 26 17:36:50 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:36:50 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:36:50 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:36:50 user nova-compute[75113]:       <entry name="serial">786ed55e-75d7-4569-a87f-fd16d03f5c8d</entry>
Oct 26 17:36:50 user nova-compute[75113]:       <entry name="uuid">786ed55e-75d7-4569-a87f-fd16d03f5c8d</entry>
Oct 26 17:36:50 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:36:50 user nova-compute[75113]:     </system>
Oct 26 17:36:50 user nova-compute[75113]:   </sysinfo>
Oct 26 17:36:50 user nova-compute[75113]:   <os>
Oct 26 17:36:50 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:36:50 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:36:50 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:36:50 user nova-compute[75113]:   </os>
Oct 26 17:36:50 user nova-compute[75113]:   <features>
Oct 26 17:36:50 user nova-compute[75113]:     <acpi/>
Oct 26 17:36:50 user nova-compute[75113]:     <apic/>
Oct 26 17:36:50 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:36:50 user nova-compute[75113]:   </features>
Oct 26 17:36:50 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:36:50 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:36:50 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:36:50 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:36:50 user nova-compute[75113]:   </clock>
Oct 26 17:36:50 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:36:50 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:36:50 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:36:50 user nova-compute[75113]:   </cpu>
Oct 26 17:36:50 user nova-compute[75113]:   <devices>
Oct 26 17:36:50 user nova-compute[75113]:     <disk type="file" device="disk">
Oct 26 17:36:50 user nova-compute[75113]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 17:36:50 user nova-compute[75113]:       <source file="/opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk"/>
Oct 26 17:36:50 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:36:50 user nova-compute[75113]:     </disk>
Oct 26 17:36:50 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:36:50 user nova-compute[75113]:       <mac address="fa:16:3e:76:5f:56"/>
Oct 26 17:36:50 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:36:50 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:36:50 user nova-compute[75113]:       <target dev="tapc2fdebb9-6c"/>
Oct 26 17:36:50 user nova-compute[75113]:     </interface>
Oct 26 17:36:50 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:36:50 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/console.log" append="off"/>
Oct 26 17:36:50 user nova-compute[75113]:     </serial>
Oct 26 17:36:50 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:36:50 user nova-compute[75113]:     <video>
Oct 26 17:36:50 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:36:50 user nova-compute[75113]:     </video>
Oct 26 17:36:50 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:36:50 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:36:50 user nova-compute[75113]:     </rng>
Oct 26 17:36:50 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:36:50 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:36:50 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:36:50 user nova-compute[75113]:     </memballoon>
Oct 26 17:36:50 user nova-compute[75113]:   </devices>
Oct 26 17:36:50 user nova-compute[75113]: </domain>
Oct 26 17:36:50 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1686619424',display_name='tempest-AttachVolumeNegativeTest-server-1686619424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1686619424',id=49,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgi4Uy8LKyc6lQv+aApQnJKVCG9TCPr3nnRvDPISye0WXe7LSJSO9XvO9Wlwp3GI4DyRuLCUTeyU/Sw5ZCR99+x4RJWx9cqlTv1kT+5FO1WgJgb5mw04OmdF3eeEbVQjQ==',key_name='tempest-keypair-1636082607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30bd0e84d1448158ca783491ed372f5',ramdisk_id='',reservation_id='r-2i0h0acf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1111816565',owner_user_name='tempest-AttachVolumeNegativeTest-1111816565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47bb03390d7d489d91750653f399125f',uuid=786ed55e-75d7-4569-a87f-fd16d03f5c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "address": "fa:16:3e:76:5f:56", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fdebb9-6c", "ovs_interfaceid": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converting VIF {"id": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "address": "fa:16:3e:76:5f:56", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fdebb9-6c", "ovs_interfaceid": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=c2fdebb9-6cfa-4140-aec5-28c464e550a5,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fdebb9-6c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_vif [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=c2fdebb9-6cfa-4140-aec5-28c464e550a5,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fdebb9-6c') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a055ded-5f6c-5a35-abcf-1322cc380d7d', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2fdebb9-6c, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2fdebb9-6c, col_values=(('qos', UUID('1b6025b6-ece7-4b69-a597-13fc9351b1e9')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2fdebb9-6c, col_values=(('external_ids', {'iface-id': 'c2fdebb9-6cfa-4140-aec5-28c464e550a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:5f:56', 'vm-uuid': '786ed55e-75d7-4569-a87f-fd16d03f5c8d'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:50 user nova-compute[75113]: INFO os_vif [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=c2fdebb9-6cfa-4140-aec5-28c464e550a5,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fdebb9-6c')
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No VIF found with MAC fa:16:3e:76:5f:56, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.compute.manager [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:36:50 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Creating image(s)
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Ensure instance console log exists: /opt/stack/data/nova/instances/42a2fbed-6d09-43f2-940e-5a686b150ae8/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Start _get_guest_xml network_info=[{"id": "5eebf416-d042-43d8-b5dd-11f92217cc87", "address": "fa:16:3e:db:eb:57", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eebf416-d0", "ovs_interfaceid": "5eebf416-d042-43d8-b5dd-11f92217cc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-26T17:36:12Z,direct_url=<?>,disk_format='qcow2',id=c3197d56-0a80-4aa1-9726-0df83a934a5c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1570408958',owner='9bf93275d83e4eeeb9f8d1dc96d6e7f8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-26T17:36:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '47e70a75-ade9-41e8-93ee-0448ad47fdc8', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mAYkEKOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42a2fbed-6d09-43f2-940e-5a686b150ae8', 'attached_at': '', 'detached_at': '', 'volume_id': '074681dc-103a-4fe9-8995-4d2e1f59028d', 'serial': '074681dc-103a-4fe9-8995-4d2e1f59028d'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:36:50 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:36:50 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-26T17:36:12Z,direct_url=<?>,disk_format='qcow2',id=c3197d56-0a80-4aa1-9726-0df83a934a5c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1570408958',owner='9bf93275d83e4eeeb9f8d1dc96d6e7f8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-26T17:36:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mAYkEKOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:36:50 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:36:50 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:36:50 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[39361daf-e2c6-4010-b17e-292d389c471a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:36:50 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[803e994b-1b48-4897-8552-c0d7052ff54e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d] added
Oct 26 17:36:50 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d330f5ef-be7c-415e-a066-0e8dce026979]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[79108013-1b72-4ef5-9b6b-f8f65f25030d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.network.neutron [req-7475658c-efbf-4401-865f-17cc29b9b4c6 req-7819a9e7-87d8-4c82-a71c-33183c6373cc service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Updated VIF entry in instance network info cache for port c2fdebb9-6cfa-4140-aec5-28c464e550a5. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG nova.network.neutron [req-7475658c-efbf-4401-865f-17cc29b9b4c6 req-7819a9e7-87d8-4c82-a71c-33183c6373cc service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Updating instance_info_cache with network_info: [{"id": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "address": "fa:16:3e:76:5f:56", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fdebb9-6c", "ovs_interfaceid": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mAYkEKOG {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7475658c-efbf-4401-865f-17cc29b9b4c6 req-7819a9e7-87d8-4c82-a71c-33183c6373cc service nova] Releasing lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mAYkEKOG" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e468398-f56d-48d2-9cbf-2e6a5d3660ae]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mAYkEKOG'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a4517a-f94f-4622-a063-869dd8ed1fc5]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b144151-260c-43c6-a5f5-f1dec06c0d51]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:36:50 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:36:50 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3719a83a-15a8-4048-923e-7a8ce6cd3d44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d, portal: 172.16.0.220,3260]
Oct 26 17:36:50 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d, portal: 172.16.0.220,3260] successful.
Oct 26 17:36:50 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef3881b-88a5-42a2-a96e-9811f5993c9d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57798173-6517-4e98-a53e-d1e80d5eb908]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:36:50 user nova-compute[75113]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d (non-flash)
Oct 26 17:36:50 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:36:50 user nova-compute[75113]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d (non-flash)
Oct 26 17:36:50 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9adc4d6-33b6-403d-a896-70e872e51174]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:36:50 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mAYkEKOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23461393639343837', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461393639343837', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-ddfccc0e-c9cb-4474-86f2-00be9ac44e11 req-06edc97a-9294-42d2-89d8-bea05162d651 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Received event network-vif-plugged-c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ddfccc0e-c9cb-4474-86f2-00be9ac44e11 req-06edc97a-9294-42d2-89d8-bea05162d651 service nova] Acquiring lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ddfccc0e-c9cb-4474-86f2-00be9ac44e11 req-06edc97a-9294-42d2-89d8-bea05162d651 service nova] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ddfccc0e-c9cb-4474-86f2-00be9ac44e11 req-06edc97a-9294-42d2-89d8-bea05162d651 service nova] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG nova.compute.manager [req-ddfccc0e-c9cb-4474-86f2-00be9ac44e11 req-06edc97a-9294-42d2-89d8-bea05162d651 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] No waiting events found dispatching network-vif-plugged-c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:36:51 user nova-compute[75113]: WARNING nova.compute.manager [req-ddfccc0e-c9cb-4474-86f2-00be9ac44e11 req-06edc97a-9294-42d2-89d8-bea05162d651 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Received unexpected event network-vif-plugged-c2fdebb9-6cfa-4140-aec5-28c464e550a5 for instance with vm_state building and task_state spawning.
Oct 26 17:36:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1256628981',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1256628981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1256628981',id=48,image_ref='c3197d56-0a80-4aa1-9726-0df83a934a5c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4qb4NrCKqVRZ8FWNDaT7jD0fw4IEItS70qpp+85QyuzMPzJSDJ0FiZ24C2Jg2mjkuZwWEJyRp61yD/8X7wo8FFh/qNX+2TxDXiBsTTogdiRpyIA+l6gxgXgA8I8Xgfxw==',key_name='tempest-keypair-356524495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-eua3k59s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-27660292',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:36:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=42a2fbed-6d09-43f2-940e-5a686b150ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5eebf416-d042-43d8-b5dd-11f92217cc87", "address": "fa:16:3e:db:eb:57", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eebf416-d0", "ovs_interfaceid": "5eebf416-d042-43d8-b5dd-11f92217cc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "5eebf416-d042-43d8-b5dd-11f92217cc87", "address": "fa:16:3e:db:eb:57", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eebf416-d0", "ovs_interfaceid": "5eebf416-d042-43d8-b5dd-11f92217cc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:eb:57,bridge_name='br-int',has_traffic_filtering=True,id=5eebf416-d042-43d8-b5dd-11f92217cc87,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eebf416-d0') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG nova.objects.instance [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lazy-loading 'pci_devices' on Instance uuid 42a2fbed-6d09-43f2-940e-5a686b150ae8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:36:51 user nova-compute[75113]:   <uuid>42a2fbed-6d09-43f2-940e-5a686b150ae8</uuid>
Oct 26 17:36:51 user nova-compute[75113]:   <name>instance-00000030</name>
Oct 26 17:36:51 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:36:51 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:36:51 user nova-compute[75113]:   <metadata>
Oct 26 17:36:51 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:36:51 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:36:51 user nova-compute[75113]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1256628981</nova:name>
Oct 26 17:36:51 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:36:50</nova:creationTime>
Oct 26 17:36:51 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:36:51 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:36:51 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:36:51 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:36:51 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:36:51 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:36:51 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:36:51 user nova-compute[75113]:       <nova:owner>
Oct 26 17:36:51 user nova-compute[75113]:         <nova:user uuid="81bf8ffc2a3746ad9f895d7c2118e33a">tempest-TestVolumeBootPattern-27660292-project-member</nova:user>
Oct 26 17:36:51 user nova-compute[75113]:         <nova:project uuid="9bf93275d83e4eeeb9f8d1dc96d6e7f8">tempest-TestVolumeBootPattern-27660292</nova:project>
Oct 26 17:36:51 user nova-compute[75113]:       </nova:owner>
Oct 26 17:36:51 user nova-compute[75113]:       <nova:root type="image" uuid="c3197d56-0a80-4aa1-9726-0df83a934a5c"/>
Oct 26 17:36:51 user nova-compute[75113]:       <nova:ports>
Oct 26 17:36:51 user nova-compute[75113]:         <nova:port uuid="5eebf416-d042-43d8-b5dd-11f92217cc87">
Oct 26 17:36:51 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 17:36:51 user nova-compute[75113]:         </nova:port>
Oct 26 17:36:51 user nova-compute[75113]:       </nova:ports>
Oct 26 17:36:51 user nova-compute[75113]:     </nova:instance>
Oct 26 17:36:51 user nova-compute[75113]:   </metadata>
Oct 26 17:36:51 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:36:51 user nova-compute[75113]:     <system>
Oct 26 17:36:51 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:36:51 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:36:51 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:36:51 user nova-compute[75113]:       <entry name="serial">42a2fbed-6d09-43f2-940e-5a686b150ae8</entry>
Oct 26 17:36:51 user nova-compute[75113]:       <entry name="uuid">42a2fbed-6d09-43f2-940e-5a686b150ae8</entry>
Oct 26 17:36:51 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:36:51 user nova-compute[75113]:     </system>
Oct 26 17:36:51 user nova-compute[75113]:   </sysinfo>
Oct 26 17:36:51 user nova-compute[75113]:   <os>
Oct 26 17:36:51 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:36:51 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:36:51 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:36:51 user nova-compute[75113]:   </os>
Oct 26 17:36:51 user nova-compute[75113]:   <features>
Oct 26 17:36:51 user nova-compute[75113]:     <acpi/>
Oct 26 17:36:51 user nova-compute[75113]:     <apic/>
Oct 26 17:36:51 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:36:51 user nova-compute[75113]:   </features>
Oct 26 17:36:51 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:36:51 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:36:51 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:36:51 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:36:51 user nova-compute[75113]:   </clock>
Oct 26 17:36:51 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:36:51 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:36:51 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:36:51 user nova-compute[75113]:   </cpu>
Oct 26 17:36:51 user nova-compute[75113]:   <devices>
Oct 26 17:36:51 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:36:51 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:36:51 user nova-compute[75113]:       <source dev="/dev/sdb"/>
Oct 26 17:36:51 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:36:51 user nova-compute[75113]:       <serial>074681dc-103a-4fe9-8995-4d2e1f59028d</serial>
Oct 26 17:36:51 user nova-compute[75113]:     </disk>
Oct 26 17:36:51 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:36:51 user nova-compute[75113]:       <mac address="fa:16:3e:db:eb:57"/>
Oct 26 17:36:51 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:36:51 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:36:51 user nova-compute[75113]:       <target dev="tap5eebf416-d0"/>
Oct 26 17:36:51 user nova-compute[75113]:     </interface>
Oct 26 17:36:51 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:36:51 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/42a2fbed-6d09-43f2-940e-5a686b150ae8/console.log" append="off"/>
Oct 26 17:36:51 user nova-compute[75113]:     </serial>
Oct 26 17:36:51 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:36:51 user nova-compute[75113]:     <video>
Oct 26 17:36:51 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:36:51 user nova-compute[75113]:     </video>
Oct 26 17:36:51 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:36:51 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:36:51 user nova-compute[75113]:     </rng>
Oct 26 17:36:51 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:36:51 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:36:51 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:36:51 user nova-compute[75113]:     </memballoon>
Oct 26 17:36:51 user nova-compute[75113]:   </devices>
Oct 26 17:36:51 user nova-compute[75113]: </domain>
Oct 26 17:36:51 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1256628981',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1256628981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1256628981',id=48,image_ref='c3197d56-0a80-4aa1-9726-0df83a934a5c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4qb4NrCKqVRZ8FWNDaT7jD0fw4IEItS70qpp+85QyuzMPzJSDJ0FiZ24C2Jg2mjkuZwWEJyRp61yD/8X7wo8FFh/qNX+2TxDXiBsTTogdiRpyIA+l6gxgXgA8I8Xgfxw==',key_name='tempest-keypair-356524495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-eua3k59s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-27660292',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:36:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=42a2fbed-6d09-43f2-940e-5a686b150ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5eebf416-d042-43d8-b5dd-11f92217cc87", "address": "fa:16:3e:db:eb:57", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eebf416-d0", "ovs_interfaceid": "5eebf416-d042-43d8-b5dd-11f92217cc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "5eebf416-d042-43d8-b5dd-11f92217cc87", "address": "fa:16:3e:db:eb:57", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eebf416-d0", "ovs_interfaceid": "5eebf416-d042-43d8-b5dd-11f92217cc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:eb:57,bridge_name='br-int',has_traffic_filtering=True,id=5eebf416-d042-43d8-b5dd-11f92217cc87,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eebf416-d0') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG os_vif [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:eb:57,bridge_name='br-int',has_traffic_filtering=True,id=5eebf416-d042-43d8-b5dd-11f92217cc87,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eebf416-d0') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8caf7c9-4eac-536c-b0fd-481ecf23c0de', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5eebf416-d0, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5eebf416-d0, col_values=(('qos', UUID('b1728fc5-11ad-492b-9fe6-067fe2a5939d')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5eebf416-d0, col_values=(('external_ids', {'iface-id': '5eebf416-d042-43d8-b5dd-11f92217cc87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:eb:57', 'vm-uuid': '42a2fbed-6d09-43f2-940e-5a686b150ae8'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:36:51 user nova-compute[75113]: INFO os_vif [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:eb:57,bridge_name='br-int',has_traffic_filtering=True,id=5eebf416-d042-43d8-b5dd-11f92217cc87,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eebf416-d0')
Oct 26 17:36:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:36:51 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] No VIF found with MAC fa:16:3e:db:eb:57, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:36:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:36:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-3c69c877-e6aa-4dc7-8947-7317cacc4643 req-e53f6740-3ec2-4ede-9b95-5f698d017595 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Received event network-vif-plugged-c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:36:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3c69c877-e6aa-4dc7-8947-7317cacc4643 req-e53f6740-3ec2-4ede-9b95-5f698d017595 service nova] Acquiring lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3c69c877-e6aa-4dc7-8947-7317cacc4643 req-e53f6740-3ec2-4ede-9b95-5f698d017595 service nova] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3c69c877-e6aa-4dc7-8947-7317cacc4643 req-e53f6740-3ec2-4ede-9b95-5f698d017595 service nova] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-3c69c877-e6aa-4dc7-8947-7317cacc4643 req-e53f6740-3ec2-4ede-9b95-5f698d017595 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] No waiting events found dispatching network-vif-plugged-c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:36:53 user nova-compute[75113]: WARNING nova.compute.manager [req-3c69c877-e6aa-4dc7-8947-7317cacc4643 req-e53f6740-3ec2-4ede-9b95-5f698d017595 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Received unexpected event network-vif-plugged-c2fdebb9-6cfa-4140-aec5-28c464e550a5 for instance with vm_state building and task_state spawning.
Oct 26 17:36:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-3c69c877-e6aa-4dc7-8947-7317cacc4643 req-e53f6740-3ec2-4ede-9b95-5f698d017595 service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Received event network-vif-plugged-5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:36:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3c69c877-e6aa-4dc7-8947-7317cacc4643 req-e53f6740-3ec2-4ede-9b95-5f698d017595 service nova] Acquiring lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3c69c877-e6aa-4dc7-8947-7317cacc4643 req-e53f6740-3ec2-4ede-9b95-5f698d017595 service nova] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:53 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-3c69c877-e6aa-4dc7-8947-7317cacc4643 req-e53f6740-3ec2-4ede-9b95-5f698d017595 service nova] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:53 user nova-compute[75113]: DEBUG nova.compute.manager [req-3c69c877-e6aa-4dc7-8947-7317cacc4643 req-e53f6740-3ec2-4ede-9b95-5f698d017595 service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] No waiting events found dispatching network-vif-plugged-5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:36:53 user nova-compute[75113]: WARNING nova.compute.manager [req-3c69c877-e6aa-4dc7-8947-7317cacc4643 req-e53f6740-3ec2-4ede-9b95-5f698d017595 service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Received unexpected event network-vif-plugged-5eebf416-d042-43d8-b5dd-11f92217cc87 for instance with vm_state building and task_state spawning.
Oct 26 17:36:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:36:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:36:54 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Instance spawned successfully.
Oct 26 17:36:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:36:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:36:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:36:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:36:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:36:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:36:54 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:36:54 user nova-compute[75113]: INFO nova.compute.manager [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Took 6.55 seconds to spawn the instance on the hypervisor.
Oct 26 17:36:54 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:36:54 user nova-compute[75113]: INFO nova.compute.manager [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Took 7.14 seconds to build instance.
Oct 26 17:36:54 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2d22bebe-5e72-4bcb-88fb-ac8528464f63 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.246s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:36:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:36:55 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Instance spawned successfully.
Oct 26 17:36:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:36:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:36:55 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:36:55 user nova-compute[75113]: INFO nova.compute.manager [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Took 5.36 seconds to spawn the instance on the hypervisor.
Oct 26 17:36:55 user nova-compute[75113]: DEBUG nova.compute.manager [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:36:55 user nova-compute[75113]: INFO nova.compute.manager [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Took 30.60 seconds to build instance.
Oct 26 17:36:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-87a8d9e0-392c-4002-a5b6-4e30a587114f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.701s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-f2a25f7c-1ff0-4984-9d91-d20cada09a9e req-14a563f5-d1bc-432c-b10f-a6435b8fc958 service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Received event network-vif-plugged-5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:36:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f2a25f7c-1ff0-4984-9d91-d20cada09a9e req-14a563f5-d1bc-432c-b10f-a6435b8fc958 service nova] Acquiring lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:36:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f2a25f7c-1ff0-4984-9d91-d20cada09a9e req-14a563f5-d1bc-432c-b10f-a6435b8fc958 service nova] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:36:55 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f2a25f7c-1ff0-4984-9d91-d20cada09a9e req-14a563f5-d1bc-432c-b10f-a6435b8fc958 service nova] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:36:55 user nova-compute[75113]: DEBUG nova.compute.manager [req-f2a25f7c-1ff0-4984-9d91-d20cada09a9e req-14a563f5-d1bc-432c-b10f-a6435b8fc958 service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] No waiting events found dispatching network-vif-plugged-5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:36:55 user nova-compute[75113]: WARNING nova.compute.manager [req-f2a25f7c-1ff0-4984-9d91-d20cada09a9e req-14a563f5-d1bc-432c-b10f-a6435b8fc958 service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Received unexpected event network-vif-plugged-5eebf416-d042-43d8-b5dd-11f92217cc87 for instance with vm_state active and task_state None.
Oct 26 17:36:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:36:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:04 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:37:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:37:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:37:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:37:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:37:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:37:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:37:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:37:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:37:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:21 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:23 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:37:26 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:31 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:33 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:37:34 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:37:35 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:37:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:37:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:37:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:37:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:37:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:37:37 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:37:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:37:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:37:37 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:37:37 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:37:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:37:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:37:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:37:37 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:37:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:37:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:37:38 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:37:38 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:37:38 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8642MB free_disk=24.997089385986328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:37:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:37:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:37:38 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:37:38 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 42a2fbed-6d09-43f2-940e-5a686b150ae8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:37:38 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 786ed55e-75d7-4569-a87f-fd16d03f5c8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:37:38 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:37:38 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:37:38 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:37:38 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:37:38 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:37:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:37:40 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:37:40 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:37:40 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:37:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:37:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:37:40 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:37:40 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:37:41 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Updating instance_info_cache with network_info: [{"id": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "address": "fa:16:3e:11:12:5d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb3c4b9c-c5", "ovs_interfaceid": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:37:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:37:41 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:37:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:37:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:37:41 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:37:41 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:37:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:37:51 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:37:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:37:56 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:01 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:38:06 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:11 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-4219b6c2-f647-4bd6-a75d-838afb5ea902 req-c44427e3-0b5a-4cd6-9621-c67d56448a58 service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Received event network-changed-5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-4219b6c2-f647-4bd6-a75d-838afb5ea902 req-c44427e3-0b5a-4cd6-9621-c67d56448a58 service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Refreshing instance network info cache due to event network-changed-5eebf416-d042-43d8-b5dd-11f92217cc87. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4219b6c2-f647-4bd6-a75d-838afb5ea902 req-c44427e3-0b5a-4cd6-9621-c67d56448a58 service nova] Acquiring lock "refresh_cache-42a2fbed-6d09-43f2-940e-5a686b150ae8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4219b6c2-f647-4bd6-a75d-838afb5ea902 req-c44427e3-0b5a-4cd6-9621-c67d56448a58 service nova] Acquired lock "refresh_cache-42a2fbed-6d09-43f2-940e-5a686b150ae8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG nova.network.neutron [req-4219b6c2-f647-4bd6-a75d-838afb5ea902 req-c44427e3-0b5a-4cd6-9621-c67d56448a58 service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Refreshing network info cache for port 5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG nova.network.neutron [req-4219b6c2-f647-4bd6-a75d-838afb5ea902 req-c44427e3-0b5a-4cd6-9621-c67d56448a58 service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Updated VIF entry in instance network info cache for port 5eebf416-d042-43d8-b5dd-11f92217cc87. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG nova.network.neutron [req-4219b6c2-f647-4bd6-a75d-838afb5ea902 req-c44427e3-0b5a-4cd6-9621-c67d56448a58 service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Updating instance_info_cache with network_info: [{"id": "5eebf416-d042-43d8-b5dd-11f92217cc87", "address": "fa:16:3e:db:eb:57", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eebf416-d0", "ovs_interfaceid": "5eebf416-d042-43d8-b5dd-11f92217cc87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4219b6c2-f647-4bd6-a75d-838afb5ea902 req-c44427e3-0b5a-4cd6-9621-c67d56448a58 service nova] Releasing lock "refresh_cache-42a2fbed-6d09-43f2-940e-5a686b150ae8" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "42a2fbed-6d09-43f2-940e-5a686b150ae8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:38:16 user nova-compute[75113]: INFO nova.compute.manager [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Terminating instance
Oct 26 17:38:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-db8d0549-acc5-43c5-b6d8-2c0000d4f629 req-288ece29-fe22-4bcd-9f1e-8a990f7c669c service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Received event network-vif-unplugged-5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-db8d0549-acc5-43c5-b6d8-2c0000d4f629 req-288ece29-fe22-4bcd-9f1e-8a990f7c669c service nova] Acquiring lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-db8d0549-acc5-43c5-b6d8-2c0000d4f629 req-288ece29-fe22-4bcd-9f1e-8a990f7c669c service nova] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-db8d0549-acc5-43c5-b6d8-2c0000d4f629 req-288ece29-fe22-4bcd-9f1e-8a990f7c669c service nova] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-db8d0549-acc5-43c5-b6d8-2c0000d4f629 req-288ece29-fe22-4bcd-9f1e-8a990f7c669c service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] No waiting events found dispatching network-vif-unplugged-5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-db8d0549-acc5-43c5-b6d8-2c0000d4f629 req-288ece29-fe22-4bcd-9f1e-8a990f7c669c service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Received event network-vif-unplugged-5eebf416-d042-43d8-b5dd-11f92217cc87 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:38:16 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:17 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Instance destroyed successfully.
Oct 26 17:38:17 user nova-compute[75113]: DEBUG nova.objects.instance [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lazy-loading 'resources' on Instance uuid 42a2fbed-6d09-43f2-940e-5a686b150ae8 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1256628981',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1256628981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1256628981',id=48,image_ref='c3197d56-0a80-4aa1-9726-0df83a934a5c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4qb4NrCKqVRZ8FWNDaT7jD0fw4IEItS70qpp+85QyuzMPzJSDJ0FiZ24C2Jg2mjkuZwWEJyRp61yD/8X7wo8FFh/qNX+2TxDXiBsTTogdiRpyIA+l6gxgXgA8I8Xgfxw==',key_name='tempest-keypair-356524495',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:36:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-eua3k59s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-27660292',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=42a2fbed-6d09-43f2-940e-5a686b150ae8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5eebf416-d042-43d8-b5dd-11f92217cc87", "address": "fa:16:3e:db:eb:57", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eebf416-d0", "ovs_interfaceid": "5eebf416-d042-43d8-b5dd-11f92217cc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "5eebf416-d042-43d8-b5dd-11f92217cc87", "address": "fa:16:3e:db:eb:57", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eebf416-d0", "ovs_interfaceid": "5eebf416-d042-43d8-b5dd-11f92217cc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:eb:57,bridge_name='br-int',has_traffic_filtering=True,id=5eebf416-d042-43d8-b5dd-11f92217cc87,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eebf416-d0') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_vif [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:eb:57,bridge_name='br-int',has_traffic_filtering=True,id=5eebf416-d042-43d8-b5dd-11f92217cc87,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eebf416-d0') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5eebf416-d0, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1728fc5-11ad-492b-9fe6-067fe2a5939d) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:38:17 user nova-compute[75113]: INFO os_vif [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:eb:57,bridge_name='br-int',has_traffic_filtering=True,id=5eebf416-d042-43d8-b5dd-11f92217cc87,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eebf416-d0')
Oct 26 17:38:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mAYkEKOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:38:17 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[146c596a-640f-43eb-b00d-af9a5a6175f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:38:17 user nova-compute[75113]: No targets found.
Oct 26 17:38:17 user nova-compute[75113]: iSNS:
Oct 26 17:38:17 user nova-compute[75113]: No targets found.
Oct 26 17:38:17 user nova-compute[75113]: STATIC:
Oct 26 17:38:17 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a
Oct 26 17:38:17 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:38:17 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:38:17 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d
Oct 26 17:38:17 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:38:17 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:38:17 user nova-compute[75113]: FIRMWARE:
Oct 26 17:38:17 user nova-compute[75113]: No targets found.
Oct 26 17:38:17 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:38:17 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:38:17 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[151e0c21-bdc2-42a2-8b29-1c81e6041997]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3771ec8-9e89-456c-a255-b9dd88bbb849]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:38:17 user nova-compute[75113]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d (non-flash)
Oct 26 17:38:17 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:38:17 user nova-compute[75113]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d (non-flash)
Oct 26 17:38:17 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914361d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d22a0a-417d-4ebe-bda0-e7c8aec8c75e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c83d8c7-faaf-4dc7-b80f-e978c01f4047]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db19a69-1a42-4a2a-9e22-644f1b7f905e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f53e5c-8971-43d5-9edd-19b014bdb1a8]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO714ed413-4a969487fc494d76', '/dev/disk/by-id/scsi-23461393639343837', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_714ed413') {{(pid=86603) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db193ae-4277-4263-86b7-1a5e2201ef86]: (4, None) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f826d6b-5f61-400e-9002-7c9579654034]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[165487c1-da0c-4704-a0c1-3b48d2c20c18]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d, portal: 172.16.0.220,3260]
Oct 26 17:38:17 user nova-compute[75113]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d, portal: 172.16.0.220,3260] successful.
Oct 26 17:38:17 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074681dc-103a-4fe9-8995-4d2e1f59028d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3298d3-d6ee-428c-91d8-1e1ada23e2df]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== disconnect_volume: return (341ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:38:17 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Deleting instance files /opt/stack/data/nova/instances/42a2fbed-6d09-43f2-940e-5a686b150ae8_del
Oct 26 17:38:17 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Deletion of /opt/stack/data/nova/instances/42a2fbed-6d09-43f2-940e-5a686b150ae8_del complete
Oct 26 17:38:17 user nova-compute[75113]: INFO nova.compute.manager [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Took 1.23 seconds to destroy the instance on the hypervisor.
Oct 26 17:38:17 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:38:17 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:38:18 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:38:18 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Took 0.79 seconds to deallocate network for instance.
Oct 26 17:38:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-1107708c-90ea-49b8-824d-cd78f27a4748 req-0e267b96-f82a-4c5b-a48d-514f55dd8302 service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Received event network-vif-deleted-5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:38:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-0ad2b6bd-b354-466e-9fd2-9e146e8efc2b req-9881595e-ffcf-4f02-8b1d-ed5a530a2ddf service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Received event network-vif-plugged-5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:38:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0ad2b6bd-b354-466e-9fd2-9e146e8efc2b req-9881595e-ffcf-4f02-8b1d-ed5a530a2ddf service nova] Acquiring lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:38:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0ad2b6bd-b354-466e-9fd2-9e146e8efc2b req-9881595e-ffcf-4f02-8b1d-ed5a530a2ddf service nova] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:38:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0ad2b6bd-b354-466e-9fd2-9e146e8efc2b req-9881595e-ffcf-4f02-8b1d-ed5a530a2ddf service nova] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:38:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-0ad2b6bd-b354-466e-9fd2-9e146e8efc2b req-9881595e-ffcf-4f02-8b1d-ed5a530a2ddf service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] No waiting events found dispatching network-vif-plugged-5eebf416-d042-43d8-b5dd-11f92217cc87 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:38:19 user nova-compute[75113]: WARNING nova.compute.manager [req-0ad2b6bd-b354-466e-9fd2-9e146e8efc2b req-9881595e-ffcf-4f02-8b1d-ed5a530a2ddf service nova] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Received unexpected event network-vif-plugged-5eebf416-d042-43d8-b5dd-11f92217cc87 for instance with vm_state active and task_state deleting.
Oct 26 17:38:19 user nova-compute[75113]: INFO nova.compute.manager [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Took 0.93 seconds to detach 1 volumes for instance.
Oct 26 17:38:19 user nova-compute[75113]: DEBUG nova.compute.manager [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 42a2fbed-6d09-43f2-940e-5a686b150ae8] Deleting volume: 074681dc-103a-4fe9-8995-4d2e1f59028d {{(pid=75113) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 17:38:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:38:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:38:19 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:38:19 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:38:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:38:20 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Deleted allocations for instance 42a2fbed-6d09-43f2-940e-5a686b150ae8
Oct 26 17:38:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-04a981a4-20ec-4c29-b5a5-88757dfadc63 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "42a2fbed-6d09-43f2-940e-5a686b150ae8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.587s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:38:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:38:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:38:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:35 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:38:36 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:38:36 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:38:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:38 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:38:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:38:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:38:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:38:38 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:38:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:38 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-4b76dbed-a462-49d7-991d-0047d63b6599 req-e528086e-7a6a-49bb-9198-ecec1bd6c049 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Received event network-changed-c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG nova.compute.manager [req-4b76dbed-a462-49d7-991d-0047d63b6599 req-e528086e-7a6a-49bb-9198-ecec1bd6c049 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Refreshing instance network info cache due to event network-changed-c2fdebb9-6cfa-4140-aec5-28c464e550a5. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4b76dbed-a462-49d7-991d-0047d63b6599 req-e528086e-7a6a-49bb-9198-ecec1bd6c049 service nova] Acquiring lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4b76dbed-a462-49d7-991d-0047d63b6599 req-e528086e-7a6a-49bb-9198-ecec1bd6c049 service nova] Acquired lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG nova.network.neutron [req-4b76dbed-a462-49d7-991d-0047d63b6599 req-e528086e-7a6a-49bb-9198-ecec1bd6c049 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Refreshing network info cache for port c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:38:39 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:38:39 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:38:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8755MB free_disk=24.987060546875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 786ed55e-75d7-4569-a87f-fd16d03f5c8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG nova.network.neutron [req-4b76dbed-a462-49d7-991d-0047d63b6599 req-e528086e-7a6a-49bb-9198-ecec1bd6c049 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Updated VIF entry in instance network info cache for port c2fdebb9-6cfa-4140-aec5-28c464e550a5. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG nova.network.neutron [req-4b76dbed-a462-49d7-991d-0047d63b6599 req-e528086e-7a6a-49bb-9198-ecec1bd6c049 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Updating instance_info_cache with network_info: [{"id": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "address": "fa:16:3e:76:5f:56", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fdebb9-6c", "ovs_interfaceid": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:38:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4b76dbed-a462-49d7-991d-0047d63b6599 req-e528086e-7a6a-49bb-9198-ecec1bd6c049 service nova] Releasing lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:38:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:38:41 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:38:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:38:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:38:41 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:38:41 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Updating instance_info_cache with network_info: [{"id": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "address": "fa:16:3e:76:5f:56", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fdebb9-6c", "ovs_interfaceid": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:38:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:38:41 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:38:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:38:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:38:41 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:38:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:38:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:38:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:38:44 user nova-compute[75113]: DEBUG nova.objects.instance [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'flavor' on Instance uuid 786ed55e-75d7-4569-a87f-fd16d03f5c8d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:38:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:38:45 user nova-compute[75113]: INFO nova.compute.manager [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Attaching volume cfc65e93-d37d-411d-8ce5-b6efbc91eff4 to /dev/vdb
Oct 26 17:38:45 user nova-compute[75113]: DEBUG os_brick.utils [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be3246a-d7a5-4ca6-9774-72c881406d82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[85375df5-193e-49a3-8558-41f30975cebf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f253ad22-226e-4cd7-b961-106b202d81bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0873fc5-f35a-4f4d-81b6-11e287c8e1ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:38:45 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:38:45 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f868964-7952-409d-9987-d05a1a62dd11]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG os_brick.utils [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:38:45 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Updating existing volume attachment record: 4ba8a5db-ad7c-42cd-a4e8-b06a71676b7d {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:38:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:53 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:38:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:38:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzKpBHOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:39:03 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:39:03 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:39:03 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa9be14-c928-4940-98ea-1103f28f703c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:39:03 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c26b65-cce7-48b4-a4df-bb1c009b509a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4] added
Oct 26 17:39:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[508b3829-92d7-4c78-8209-cfef9cfd0606]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32fb597-811c-4397-9e2c-8b6d0070cb1d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JzKpBHOZ {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JzKpBHOZ" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0e58e4-57f8-470c-9559-a71d8859650e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JzKpBHOZ'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7ecdcc-eb9d-4089-9405-e17646baf101]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[494022e4-a559-474d-83f1-60b63882fb96]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:39:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:39:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fed18d-5317-493c-b6d6-8bddd06c1f8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4, portal: 172.16.0.220,3260]
Oct 26 17:39:03 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4, portal: 172.16.0.220,3260] successful.
Oct 26 17:39:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e944ad-7a2a-49fb-a962-e46381934409]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e487a92-f93b-44f3-8804-a797dd06396a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:39:03 user nova-compute[75113]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 (non-flash)
Oct 26 17:39:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:39:03 user nova-compute[75113]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 (non-flash)
Oct 26 17:39:03 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4939e636-abfc-49af-806b-26d6bc2b32aa]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:03 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:39:04 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:39:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzKpBHOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:39:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:39:04 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26231656230396435', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:39:04 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231656230396435', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:39:04 user nova-compute[75113]: DEBUG nova.objects.instance [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'flavor' on Instance uuid 786ed55e-75d7-4569-a87f-fd16d03f5c8d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:39:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 17:39:05 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:39:05 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:39:05 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:39:05 user nova-compute[75113]:   <serial>cfc65e93-d37d-411d-8ce5-b6efbc91eff4</serial>
Oct 26 17:39:05 user nova-compute[75113]: </disk>
Oct 26 17:39:05 user nova-compute[75113]:  {{(pid=75113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 17:39:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:39:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:39:05 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] No VIF found with MAC fa:16:3e:76:5f:56, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:39:05 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cb50d2ac-0549-446f-a4c5-71a026eb7b7f tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.472s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:07 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:07 user nova-compute[75113]: INFO nova.compute.manager [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Detaching volume cfc65e93-d37d-411d-8ce5-b6efbc91eff4
Oct 26 17:39:07 user nova-compute[75113]: INFO nova.virt.block_device [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Attempting to driver detach volume cfc65e93-d37d-411d-8ce5-b6efbc91eff4 from mountpoint /dev/vdb
Oct 26 17:39:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Attempting to detach device vdb from instance 786ed55e-75d7-4569-a87f-fd16d03f5c8d from the persistent domain config. {{(pid=75113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 17:39:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:39:07 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:39:07 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:39:07 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:39:07 user nova-compute[75113]:   <serial>cfc65e93-d37d-411d-8ce5-b6efbc91eff4</serial>
Oct 26 17:39:07 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:39:07 user nova-compute[75113]: </disk>
Oct 26 17:39:07 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:39:07 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully detached device vdb from instance 786ed55e-75d7-4569-a87f-fd16d03f5c8d from the persistent domain config.
Oct 26 17:39:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 786ed55e-75d7-4569-a87f-fd16d03f5c8d from the live domain config. {{(pid=75113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 17:39:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.guest [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 17:39:07 user nova-compute[75113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:39:07 user nova-compute[75113]:   <source dev="/dev/sdb"/>
Oct 26 17:39:07 user nova-compute[75113]:   <target dev="vdb" bus="virtio"/>
Oct 26 17:39:07 user nova-compute[75113]:   <serial>cfc65e93-d37d-411d-8ce5-b6efbc91eff4</serial>
Oct 26 17:39:07 user nova-compute[75113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 17:39:07 user nova-compute[75113]: </disk>
Oct 26 17:39:07 user nova-compute[75113]:  {{(pid=75113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 17:39:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:39:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:39:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:39:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:39:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:07 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 786ed55e-75d7-4569-a87f-fd16d03f5c8d {{(pid=75113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 17:39:09 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:39:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:17 user nova-compute[75113]: INFO nova.compute.manager [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Terminating instance
Oct 26 17:39:17 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:39:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-718c808b-c839-4ac7-b802-ff84d7e33493 req-1e303e3e-88bc-45fb-a8ac-ed1149b2f5d1 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received event network-vif-unplugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-718c808b-c839-4ac7-b802-ff84d7e33493 req-1e303e3e-88bc-45fb-a8ac-ed1149b2f5d1 service nova] Acquiring lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-718c808b-c839-4ac7-b802-ff84d7e33493 req-1e303e3e-88bc-45fb-a8ac-ed1149b2f5d1 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-718c808b-c839-4ac7-b802-ff84d7e33493 req-1e303e3e-88bc-45fb-a8ac-ed1149b2f5d1 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-718c808b-c839-4ac7-b802-ff84d7e33493 req-1e303e3e-88bc-45fb-a8ac-ed1149b2f5d1 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] No waiting events found dispatching network-vif-unplugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-718c808b-c839-4ac7-b802-ff84d7e33493 req-1e303e3e-88bc-45fb-a8ac-ed1149b2f5d1 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received event network-vif-unplugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:18 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Instance destroyed successfully.
Oct 26 17:39:18 user nova-compute[75113]: DEBUG nova.objects.instance [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lazy-loading 'resources' on Instance uuid 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:34:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2042664630',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2042664630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2042664630',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPg98b8+niy8MgKhwt9jZ8IbMdWaBUwi/OKEDDG5hWGG+OMPBVBvJs1CUYZcdI+2JkiPWhm6E1SI4xIgJHrkBTdp+eNb3oPKFaMqb53R/4H3MrJI2vCfOmF+UJ2s3HbaA==',key_name='tempest-keypair-1260591920',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-6ejvn600',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=3eda4ed5-fb21-47bd-97e1-d6aa193ff27c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "address": "fa:16:3e:11:12:5d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb3c4b9c-c5", "ovs_interfaceid": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "address": "fa:16:3e:11:12:5d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb3c4b9c-c5", "ovs_interfaceid": "bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb3c4b9c-c5') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_vif [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb3c4b9c-c5') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb3c4b9c-c5, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a65eab1-aa60-4406-a736-9e5e089a8620) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:39:18 user nova-compute[75113]: INFO os_vif [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb3c4b9c-c5')
Oct 26 17:39:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgHkOcWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:39:18 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[544ced97-8d33-4a53-bddd-42ab44408d48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:39:18 user nova-compute[75113]: No targets found.
Oct 26 17:39:18 user nova-compute[75113]: iSNS:
Oct 26 17:39:18 user nova-compute[75113]: No targets found.
Oct 26 17:39:18 user nova-compute[75113]: STATIC:
Oct 26 17:39:18 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a
Oct 26 17:39:18 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:39:18 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:39:18 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4
Oct 26 17:39:18 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:39:18 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:39:18 user nova-compute[75113]: FIRMWARE:
Oct 26 17:39:18 user nova-compute[75113]: No targets found.
Oct 26 17:39:18 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:39:18 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:39:18 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd976f0-93e4-41dd-839e-3bd822687ed4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[170143ea-3332-4516-91eb-5d4e83072b11]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:39:18 user nova-compute[75113]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 (non-flash)
Oct 26 17:39:18 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a (non-flash)
Oct 26 17:39:18 user nova-compute[75113]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 (non-flash)
Oct 26 17:39:18 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49142bd630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a'): ({'sdc'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Removing single pathed devices sdc {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0591de3a-dd1b-4f9b-b159-604ffebb01aa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc23b6a-ea78-41d4-b515-3bacee4b095c]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flushing IO for device /dev/sdc {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[553d8c21-37e8-4f4c-9fdf-0825f8eaeda3]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78914b1-832b-4fe2-9b15-512f7f0ed087]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bdd38fdc', '/dev/disk/by-id/scsi-1SCST_BIObdd38fdc-6390f85c3f92c0ae', '/dev/disk/by-id/scsi-23633393066383563') {{(pid=86603) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb59628f-f117-46cc-b4ae-1ed5c4865153]: (4, None) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd29fbf-199a-44de-9753-5295f4da02ca]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12d95c9-04ea-432f-b870-9d790fec0162]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a, portal: 172.16.0.220,3260]
Oct 26 17:39:18 user nova-compute[75113]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a, portal: 172.16.0.220,3260] successful.
Oct 26 17:39:18 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db5d223-edcb-43da-8584-1a1157f78b3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b518598a-73af-493b-85c5-025788cd7706]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== disconnect_volume: return (395ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:39:18 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Deleting instance files /opt/stack/data/nova/instances/3eda4ed5-fb21-47bd-97e1-d6aa193ff27c_del
Oct 26 17:39:18 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Deletion of /opt/stack/data/nova/instances/3eda4ed5-fb21-47bd-97e1-d6aa193ff27c_del complete
Oct 26 17:39:18 user nova-compute[75113]: INFO nova.compute.manager [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 26 17:39:18 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:39:18 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:39:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:19 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:39:19 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Took 0.96 seconds to deallocate network for instance.
Oct 26 17:39:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-cf58e3f3-23ca-4892-bac8-c6d1499dd7bd req-5dd4950b-13ed-4e17-9394-fc5fff24f831 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received event network-vif-deleted-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received event network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Acquiring lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] No waiting events found dispatching network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:39:20 user nova-compute[75113]: WARNING nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received unexpected event network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff for instance with vm_state active and task_state deleting.
Oct 26 17:39:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received event network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Acquiring lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] No waiting events found dispatching network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:39:20 user nova-compute[75113]: WARNING nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received unexpected event network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff for instance with vm_state active and task_state deleting.
Oct 26 17:39:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received event network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Acquiring lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] No waiting events found dispatching network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:39:20 user nova-compute[75113]: WARNING nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received unexpected event network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff for instance with vm_state active and task_state deleting.
Oct 26 17:39:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received event network-vif-unplugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Acquiring lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] No waiting events found dispatching network-vif-unplugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received event network-vif-unplugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received event network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Acquiring lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] No waiting events found dispatching network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:39:20 user nova-compute[75113]: WARNING nova.compute.manager [req-213e2dfc-c0fc-4132-964c-0eaefcf61bfc req-100b8038-36ff-4db6-a160-f531faf32f44 service nova] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Received unexpected event network-vif-plugged-bb3c4b9c-c553-4d04-9fb9-9b5656a4e5ff for instance with vm_state active and task_state deleting.
Oct 26 17:39:20 user nova-compute[75113]: INFO nova.compute.manager [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Took 0.84 seconds to detach 1 volumes for instance.
Oct 26 17:39:20 user nova-compute[75113]: DEBUG nova.compute.manager [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c] Deleting volume: 3db5d223-edcb-43da-8584-1a1157f78b3a {{(pid=75113) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:20 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:21 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:39:21 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:39:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:21 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Deleted allocations for instance 3eda4ed5-fb21-47bd-97e1-d6aa193ff27c
Oct 26 17:39:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-3d6f316c-9c9b-4870-8e92-e713eb97ef2f tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "3eda4ed5-fb21-47bd-97e1-d6aa193ff27c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.526s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:39:27 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 786ed55e-75d7-4569-a87f-fd16d03f5c8d is timed out.
Oct 26 17:39:27 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully detached device vdb from instance 786ed55e-75d7-4569-a87f-fd16d03f5c8d from the live domain config.
Oct 26 17:39:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzKpBHOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:39:27 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f80707f-d70b-4abf-99f0-214d9992614e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:39:27 user nova-compute[75113]: No targets found.
Oct 26 17:39:27 user nova-compute[75113]: iSNS:
Oct 26 17:39:27 user nova-compute[75113]: No targets found.
Oct 26 17:39:27 user nova-compute[75113]: STATIC:
Oct 26 17:39:27 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4
Oct 26 17:39:27 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:39:27 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:39:27 user nova-compute[75113]: FIRMWARE:
Oct 26 17:39:27 user nova-compute[75113]: No targets found.
Oct 26 17:39:27 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:39:27 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:39:27 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[86da98dc-29f1-4601-a2a3-c81e54cd36bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f11adab-dc71-4ac8-9ff3-6bd911e3afc9]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 (non-flash)
Oct 26 17:39:27 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 (non-flash)
Oct 26 17:39:27 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914210430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c216f54-6ab7-4d8c-948c-35488e281a47]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[da549438-3b1a-4a8a-a022-51d7f2084704]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bedc177-b429-4934-b70a-98d1af215641]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c5eba3-b711-4e31-83e7-e5758cff7e3d]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f283f8b-dc70-4aaa-a809-59bd355faa60]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.157s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a961e97-bae9-4d03-a208-d59fe003273d]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4, portal: 172.16.0.220,3260]
Oct 26 17:39:27 user nova-compute[75113]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4, portal: 172.16.0.220,3260] successful.
Oct 26 17:39:27 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfc65e93-d37d-411d-8ce5-b6efbc91eff4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e5d52c-a6d8-47d0-b93a-56d5f9761fc0]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] <== disconnect_volume: return (388ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:39:27 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:39:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:39:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:39:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:39:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:39:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:28 user nova-compute[75113]: DEBUG nova.objects.instance [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'flavor' on Instance uuid 786ed55e-75d7-4569-a87f-fd16d03f5c8d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:39:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-599e1508-66e7-4c4f-8834-8e7b7dddd918 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.877s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:36 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:39:36 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:39:36 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:39:38 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:39:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:38 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:39:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:39:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:39:38 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:39:39 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:39:39 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:39:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=24.98455047607422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:39:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 786ed55e-75d7-4569-a87f-fd16d03f5c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:39:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:39:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:39:39 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:39:39 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:39:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:39:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:39:41 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:39:41 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:39:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:39:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:39:41 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:39:41 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 786ed55e-75d7-4569-a87f-fd16d03f5c8d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:39:41 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Updating instance_info_cache with network_info: [{"id": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "address": "fa:16:3e:76:5f:56", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fdebb9-6c", "ovs_interfaceid": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:39:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-786ed55e-75d7-4569-a87f-fd16d03f5c8d" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:39:41 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:39:42 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:39:43 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:39:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:39:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:39:55 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:57 user nova-compute[75113]: INFO nova.compute.manager [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Terminating instance
Oct 26 17:39:57 user nova-compute[75113]: DEBUG nova.compute.manager [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-b49d44cc-a92d-41da-8f4c-7b3fa1e36f80 req-81638b22-41ae-4354-9014-6758bb16bb90 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Received event network-vif-unplugged-c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b49d44cc-a92d-41da-8f4c-7b3fa1e36f80 req-81638b22-41ae-4354-9014-6758bb16bb90 service nova] Acquiring lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b49d44cc-a92d-41da-8f4c-7b3fa1e36f80 req-81638b22-41ae-4354-9014-6758bb16bb90 service nova] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b49d44cc-a92d-41da-8f4c-7b3fa1e36f80 req-81638b22-41ae-4354-9014-6758bb16bb90 service nova] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-b49d44cc-a92d-41da-8f4c-7b3fa1e36f80 req-81638b22-41ae-4354-9014-6758bb16bb90 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] No waiting events found dispatching network-vif-unplugged-c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:39:57 user nova-compute[75113]: DEBUG nova.compute.manager [req-b49d44cc-a92d-41da-8f4c-7b3fa1e36f80 req-81638b22-41ae-4354-9014-6758bb16bb90 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Received event network-vif-unplugged-c2fdebb9-6cfa-4140-aec5-28c464e550a5 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:58 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Instance destroyed successfully.
Oct 26 17:39:58 user nova-compute[75113]: DEBUG nova.objects.instance [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lazy-loading 'resources' on Instance uuid 786ed55e-75d7-4569-a87f-fd16d03f5c8d {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1686619424',display_name='tempest-AttachVolumeNegativeTest-server-1686619424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1686619424',id=49,image_ref='91603055-2c31-464d-bb00-ae160ab6e467',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgi4Uy8LKyc6lQv+aApQnJKVCG9TCPr3nnRvDPISye0WXe7LSJSO9XvO9Wlwp3GI4DyRuLCUTeyU/Sw5ZCR99+x4RJWx9cqlTv1kT+5FO1WgJgb5mw04OmdF3eeEbVQjQ==',key_name='tempest-keypair-1636082607',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:36:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c30bd0e84d1448158ca783491ed372f5',ramdisk_id='',reservation_id='r-2i0h0acf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91603055-2c31-464d-bb00-ae160ab6e467',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1111816565',owner_user_name='tempest-AttachVolumeNegativeTest-1111816565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47bb03390d7d489d91750653f399125f',uuid=786ed55e-75d7-4569-a87f-fd16d03f5c8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "address": "fa:16:3e:76:5f:56", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fdebb9-6c", "ovs_interfaceid": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converting VIF {"id": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "address": "fa:16:3e:76:5f:56", "network": {"id": "a88bd256-79b1-42bd-b5fa-4af91fa12f75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1247385064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30bd0e84d1448158ca783491ed372f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fdebb9-6c", "ovs_interfaceid": "c2fdebb9-6cfa-4140-aec5-28c464e550a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=c2fdebb9-6cfa-4140-aec5-28c464e550a5,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fdebb9-6c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG os_vif [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=c2fdebb9-6cfa-4140-aec5-28c464e550a5,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fdebb9-6c') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2fdebb9-6c, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b6025b6-ece7-4b69-a597-13fc9351b1e9) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:39:58 user nova-compute[75113]: INFO os_vif [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=c2fdebb9-6cfa-4140-aec5-28c464e550a5,network=Network(a88bd256-79b1-42bd-b5fa-4af91fa12f75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fdebb9-6c')
Oct 26 17:39:58 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Deleting instance files /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d_del
Oct 26 17:39:58 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Deletion of /opt/stack/data/nova/instances/786ed55e-75d7-4569-a87f-fd16d03f5c8d_del complete
Oct 26 17:39:58 user nova-compute[75113]: INFO nova.compute.manager [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 26 17:39:58 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:39:58 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:39:59 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:39:59 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Took 1.00 seconds to deallocate network for instance.
Oct 26 17:39:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-dc2c5ff6-3150-4987-b554-3b5877d942f7 req-48e3194d-79ab-4839-b28f-6abdf767155d service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Received event network-vif-deleted-c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:39:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:59 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:39:59 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:39:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:59 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Deleted allocations for instance 786ed55e-75d7-4569-a87f-fd16d03f5c8d
Oct 26 17:39:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-05bd7d5f-4024-49be-987b-d93537a038b9 tempest-AttachVolumeNegativeTest-1111816565 tempest-AttachVolumeNegativeTest-1111816565-project-member] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.344s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-b2d59ef2-e5ff-40f7-a91d-4a57af321d0b req-9bcb6e84-714a-4f39-b985-d9429956eca0 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Received event network-vif-plugged-c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:39:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b2d59ef2-e5ff-40f7-a91d-4a57af321d0b req-9bcb6e84-714a-4f39-b985-d9429956eca0 service nova] Acquiring lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:39:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b2d59ef2-e5ff-40f7-a91d-4a57af321d0b req-9bcb6e84-714a-4f39-b985-d9429956eca0 service nova] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:39:59 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b2d59ef2-e5ff-40f7-a91d-4a57af321d0b req-9bcb6e84-714a-4f39-b985-d9429956eca0 service nova] Lock "786ed55e-75d7-4569-a87f-fd16d03f5c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:39:59 user nova-compute[75113]: DEBUG nova.compute.manager [req-b2d59ef2-e5ff-40f7-a91d-4a57af321d0b req-9bcb6e84-714a-4f39-b985-d9429956eca0 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] No waiting events found dispatching network-vif-plugged-c2fdebb9-6cfa-4140-aec5-28c464e550a5 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:39:59 user nova-compute[75113]: WARNING nova.compute.manager [req-b2d59ef2-e5ff-40f7-a91d-4a57af321d0b req-9bcb6e84-714a-4f39-b985-d9429956eca0 service nova] [instance: 786ed55e-75d7-4569-a87f-fd16d03f5c8d] Received unexpected event network-vif-plugged-c2fdebb9-6cfa-4140-aec5-28c464e550a5 for instance with vm_state deleted and task_state None.
Oct 26 17:40:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:40:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:40:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:40:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:40:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:40:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:25 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:40:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "dfed668c-07ef-440b-a4e1-5b80d625cec1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:40:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:40:28 user nova-compute[75113]: DEBUG nova.compute.manager [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:40:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:40:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:40:28 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:40:28 user nova-compute[75113]: INFO nova.compute.claims [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Claim successful on node user
Oct 26 17:40:28 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:40:28 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:40:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:40:28 user nova-compute[75113]: DEBUG nova.compute.manager [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:40:28 user nova-compute[75113]: DEBUG nova.compute.manager [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:40:28 user nova-compute[75113]: DEBUG nova.network.neutron [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:40:28 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:40:29 user nova-compute[75113]: DEBUG nova.compute.manager [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:40:29 user nova-compute[75113]: INFO nova.virt.block_device [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Booting with volume 0a07b099-3af9-42e8-8e11-178af239f0b4 at /dev/vda
Oct 26 17:40:29 user nova-compute[75113]: DEBUG os_brick.utils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57885e0-9af9-4c44-8a4d-e085d1bf3c06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG nova.policy [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81bf8ffc2a3746ad9f895d7c2118e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf93275d83e4eeeb9f8d1dc96d6e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d6d0e8-f240-45e2-aad7-6a802501232f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[099ed368-c2cd-43dc-a2a0-0b1f4fcafd9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e4211c-b20b-48f5-a89e-f246ee5dabc6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:40:29 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:40:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6098e2-dea7-4bb1-93ac-9696b9ad8340]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG os_brick.utils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:40:29 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Updating existing volume attachment record: d9463a43-2d68-4d45-91e9-647f0a2fdd54 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:40:30 user nova-compute[75113]: DEBUG nova.network.neutron [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Successfully created port: 70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:40:30 user nova-compute[75113]: DEBUG nova.network.neutron [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Successfully updated port: 70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:40:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "refresh_cache-dfed668c-07ef-440b-a4e1-5b80d625cec1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:40:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquired lock "refresh_cache-dfed668c-07ef-440b-a4e1-5b80d625cec1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:40:30 user nova-compute[75113]: DEBUG nova.network.neutron [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:40:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-b514ac1f-53be-4acf-a26a-e6bb31e0cb64 req-82277005-e5ca-49ec-8cf0-196bbfa3bb0a service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received event network-changed-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:40:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-b514ac1f-53be-4acf-a26a-e6bb31e0cb64 req-82277005-e5ca-49ec-8cf0-196bbfa3bb0a service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Refreshing instance network info cache due to event network-changed-70e6efe2-921a-4ebd-9d82-bb2fc4b96849. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:40:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b514ac1f-53be-4acf-a26a-e6bb31e0cb64 req-82277005-e5ca-49ec-8cf0-196bbfa3bb0a service nova] Acquiring lock "refresh_cache-dfed668c-07ef-440b-a4e1-5b80d625cec1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:40:30 user nova-compute[75113]: DEBUG nova.network.neutron [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:40:31 user nova-compute[75113]: DEBUG nova.network.neutron [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Updating instance_info_cache with network_info: [{"id": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "address": "fa:16:3e:c5:43:60", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e6efe2-92", "ovs_interfaceid": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:40:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Releasing lock "refresh_cache-dfed668c-07ef-440b-a4e1-5b80d625cec1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:40:31 user nova-compute[75113]: DEBUG nova.compute.manager [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Instance network_info: |[{"id": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "address": "fa:16:3e:c5:43:60", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e6efe2-92", "ovs_interfaceid": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:40:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b514ac1f-53be-4acf-a26a-e6bb31e0cb64 req-82277005-e5ca-49ec-8cf0-196bbfa3bb0a service nova] Acquired lock "refresh_cache-dfed668c-07ef-440b-a4e1-5b80d625cec1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:40:31 user nova-compute[75113]: DEBUG nova.network.neutron [req-b514ac1f-53be-4acf-a26a-e6bb31e0cb64 req-82277005-e5ca-49ec-8cf0-196bbfa3bb0a service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Refreshing network info cache for port 70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:40:31 user nova-compute[75113]: DEBUG nova.network.neutron [req-b514ac1f-53be-4acf-a26a-e6bb31e0cb64 req-82277005-e5ca-49ec-8cf0-196bbfa3bb0a service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Updated VIF entry in instance network info cache for port 70e6efe2-921a-4ebd-9d82-bb2fc4b96849. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:40:31 user nova-compute[75113]: DEBUG nova.network.neutron [req-b514ac1f-53be-4acf-a26a-e6bb31e0cb64 req-82277005-e5ca-49ec-8cf0-196bbfa3bb0a service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Updating instance_info_cache with network_info: [{"id": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "address": "fa:16:3e:c5:43:60", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e6efe2-92", "ovs_interfaceid": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:40:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-b514ac1f-53be-4acf-a26a-e6bb31e0cb64 req-82277005-e5ca-49ec-8cf0-196bbfa3bb0a service nova] Releasing lock "refresh_cache-dfed668c-07ef-440b-a4e1-5b80d625cec1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:40:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:40:36 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:40:38 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:40:38 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:40:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:40:39 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:40:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:40:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:40:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:40:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:40:39 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:40:39 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:40:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=25.010334014892578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:40:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:40:39 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:40:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance dfed668c-07ef-440b-a4e1-5b80d625cec1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:40:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:40:39 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:40:40 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:40:40 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:40:40 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:40:40 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:40:42 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:40:42 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:40:42 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:40:42 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Skipping network cache update for instance because it is Building. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 17:40:42 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 17:40:43 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:40:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:40:44 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:40:44 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:40:47 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Creating image(s)
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Ensure instance console log exists: /opt/stack/data/nova/instances/dfed668c-07ef-440b-a4e1-5b80d625cec1/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Start _get_guest_xml network_info=[{"id": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "address": "fa:16:3e:c5:43:60", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e6efe2-92", "ovs_interfaceid": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd9463a43-2d68-4d45-91e9-647f0a2fdd54', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KaHQEyjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dfed668c-07ef-440b-a4e1-5b80d625cec1', 'attached_at': '', 'detached_at': '', 'volume_id': '0a07b099-3af9-42e8-8e11-178af239f0b4', 'serial': '0a07b099-3af9-42e8-8e11-178af239f0b4'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:40:47 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:40:47 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KaHQEyjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:40:47 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:40:47 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:40:47 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[433f0287-825f-4aec-92e3-7898949db576]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:40:47 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d144533-b962-40de-b6bc-795e6b703c64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4] added
Oct 26 17:40:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a311387a-4412-4aa3-a0d0-d6d62a040453]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85bd1c4-c98b-4ab3-a6b0-628288a69f35]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KaHQEyjp {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KaHQEyjp" returned: 0 in 0.023s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece3fa40-c035-4925-ac8a-a37fb9385ea4]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KaHQEyjp'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[151bdefa-db91-4bf9-b4da-20736b11f32e]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e552376b-4b6d-4b4f-99cd-6f379d5d7ccb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:40:47 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:40:47 user nova-compute[75113]:  {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:40:47 user nova-compute[75113]: WARNING os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 17:40:47 user nova-compute[75113]: 
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb99397-15a7-45e9-be66-aba7fcacad62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260]
Oct 26 17:40:47 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260] successful.
Oct 26 17:40:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb909d56-5bbf-4025-a18a-681f149f5f01]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca018f5-d829-4695-b9b9-0259cd236657]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:40:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:40:47 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57669fe-ab05-4969-9c5b-0340eb35ad2c]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:40:47 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KaHQEyjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23030653631643562', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030653631643562', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-774329911',display_name='tempest-TestVolumeBootPattern-server-774329911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-774329911',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwKQNJGuV43brbtlRGdAvMJhBjPf39B8oXLeM8Po7JgfKYhm2iVYdrl5rrnrab3QGLKiS6e05OdA99Yvl7m6ZHVEnXLb3uZjQBChYFsMikeuB7XgifIq52X1RFutnz4/A==',key_name='tempest-TestVolumeBootPattern-2003924975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-z899fauv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:40:29Z,user_data=None,user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=dfed668c-07ef-440b-a4e1-5b80d625cec1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "address": "fa:16:3e:c5:43:60", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e6efe2-92", "ovs_interfaceid": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "address": "fa:16:3e:c5:43:60", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e6efe2-92", "ovs_interfaceid": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:43:60,bridge_name='br-int',has_traffic_filtering=True,id=70e6efe2-921a-4ebd-9d82-bb2fc4b96849,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e6efe2-92') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG nova.objects.instance [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lazy-loading 'pci_devices' on Instance uuid dfed668c-07ef-440b-a4e1-5b80d625cec1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:40:48 user nova-compute[75113]:   <uuid>dfed668c-07ef-440b-a4e1-5b80d625cec1</uuid>
Oct 26 17:40:48 user nova-compute[75113]:   <name>instance-00000032</name>
Oct 26 17:40:48 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:40:48 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:40:48 user nova-compute[75113]:   <metadata>
Oct 26 17:40:48 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:40:48 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:40:48 user nova-compute[75113]:       <nova:name>tempest-TestVolumeBootPattern-server-774329911</nova:name>
Oct 26 17:40:48 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:40:47</nova:creationTime>
Oct 26 17:40:48 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:40:48 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:40:48 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:40:48 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:40:48 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:40:48 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:40:48 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:40:48 user nova-compute[75113]:       <nova:owner>
Oct 26 17:40:48 user nova-compute[75113]:         <nova:user uuid="81bf8ffc2a3746ad9f895d7c2118e33a">tempest-TestVolumeBootPattern-27660292-project-member</nova:user>
Oct 26 17:40:48 user nova-compute[75113]:         <nova:project uuid="9bf93275d83e4eeeb9f8d1dc96d6e7f8">tempest-TestVolumeBootPattern-27660292</nova:project>
Oct 26 17:40:48 user nova-compute[75113]:       </nova:owner>
Oct 26 17:40:48 user nova-compute[75113]:       <nova:ports>
Oct 26 17:40:48 user nova-compute[75113]:         <nova:port uuid="70e6efe2-921a-4ebd-9d82-bb2fc4b96849">
Oct 26 17:40:48 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 17:40:48 user nova-compute[75113]:         </nova:port>
Oct 26 17:40:48 user nova-compute[75113]:       </nova:ports>
Oct 26 17:40:48 user nova-compute[75113]:     </nova:instance>
Oct 26 17:40:48 user nova-compute[75113]:   </metadata>
Oct 26 17:40:48 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:40:48 user nova-compute[75113]:     <system>
Oct 26 17:40:48 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:40:48 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:40:48 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:40:48 user nova-compute[75113]:       <entry name="serial">dfed668c-07ef-440b-a4e1-5b80d625cec1</entry>
Oct 26 17:40:48 user nova-compute[75113]:       <entry name="uuid">dfed668c-07ef-440b-a4e1-5b80d625cec1</entry>
Oct 26 17:40:48 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:40:48 user nova-compute[75113]:     </system>
Oct 26 17:40:48 user nova-compute[75113]:   </sysinfo>
Oct 26 17:40:48 user nova-compute[75113]:   <os>
Oct 26 17:40:48 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:40:48 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:40:48 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:40:48 user nova-compute[75113]:   </os>
Oct 26 17:40:48 user nova-compute[75113]:   <features>
Oct 26 17:40:48 user nova-compute[75113]:     <acpi/>
Oct 26 17:40:48 user nova-compute[75113]:     <apic/>
Oct 26 17:40:48 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:40:48 user nova-compute[75113]:   </features>
Oct 26 17:40:48 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:40:48 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:40:48 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:40:48 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:40:48 user nova-compute[75113]:   </clock>
Oct 26 17:40:48 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:40:48 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:40:48 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:40:48 user nova-compute[75113]:   </cpu>
Oct 26 17:40:48 user nova-compute[75113]:   <devices>
Oct 26 17:40:48 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:40:48 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:40:48 user nova-compute[75113]:       <source dev="/dev/sdb"/>
Oct 26 17:40:48 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:40:48 user nova-compute[75113]:       <serial>0a07b099-3af9-42e8-8e11-178af239f0b4</serial>
Oct 26 17:40:48 user nova-compute[75113]:     </disk>
Oct 26 17:40:48 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:40:48 user nova-compute[75113]:       <mac address="fa:16:3e:c5:43:60"/>
Oct 26 17:40:48 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:40:48 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:40:48 user nova-compute[75113]:       <target dev="tap70e6efe2-92"/>
Oct 26 17:40:48 user nova-compute[75113]:     </interface>
Oct 26 17:40:48 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:40:48 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/dfed668c-07ef-440b-a4e1-5b80d625cec1/console.log" append="off"/>
Oct 26 17:40:48 user nova-compute[75113]:     </serial>
Oct 26 17:40:48 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:40:48 user nova-compute[75113]:     <video>
Oct 26 17:40:48 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:40:48 user nova-compute[75113]:     </video>
Oct 26 17:40:48 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:40:48 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:40:48 user nova-compute[75113]:     </rng>
Oct 26 17:40:48 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:40:48 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:40:48 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:40:48 user nova-compute[75113]:     </memballoon>
Oct 26 17:40:48 user nova-compute[75113]:   </devices>
Oct 26 17:40:48 user nova-compute[75113]: </domain>
Oct 26 17:40:48 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-774329911',display_name='tempest-TestVolumeBootPattern-server-774329911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-774329911',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwKQNJGuV43brbtlRGdAvMJhBjPf39B8oXLeM8Po7JgfKYhm2iVYdrl5rrnrab3QGLKiS6e05OdA99Yvl7m6ZHVEnXLb3uZjQBChYFsMikeuB7XgifIq52X1RFutnz4/A==',key_name='tempest-TestVolumeBootPattern-2003924975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-z899fauv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:40:29Z,user_data=None,user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=dfed668c-07ef-440b-a4e1-5b80d625cec1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "address": "fa:16:3e:c5:43:60", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e6efe2-92", "ovs_interfaceid": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "address": "fa:16:3e:c5:43:60", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e6efe2-92", "ovs_interfaceid": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:43:60,bridge_name='br-int',has_traffic_filtering=True,id=70e6efe2-921a-4ebd-9d82-bb2fc4b96849,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e6efe2-92') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG os_vif [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:43:60,bridge_name='br-int',has_traffic_filtering=True,id=70e6efe2-921a-4ebd-9d82-bb2fc4b96849,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e6efe2-92') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '346ef97e-6db3-5bd1-bc7d-0deffdbac846', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70e6efe2-92, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70e6efe2-92, col_values=(('qos', UUID('c009708b-81b8-4c15-bcee-f0339165126f')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70e6efe2-92, col_values=(('external_ids', {'iface-id': '70e6efe2-921a-4ebd-9d82-bb2fc4b96849', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:43:60', 'vm-uuid': 'dfed668c-07ef-440b-a4e1-5b80d625cec1'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:48 user nova-compute[75113]: INFO os_vif [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:43:60,bridge_name='br-int',has_traffic_filtering=True,id=70e6efe2-921a-4ebd-9d82-bb2fc4b96849,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e6efe2-92')
Oct 26 17:40:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:40:48 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] No VIF found with MAC fa:16:3e:c5:43:60, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:40:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-60e00445-648b-4665-ba2b-2189b147d454 req-120aa3af-2636-4fc3-a264-5aa49e5c62a6 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received event network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:40:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-60e00445-648b-4665-ba2b-2189b147d454 req-120aa3af-2636-4fc3-a264-5aa49e5c62a6 service nova] Acquiring lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:40:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-60e00445-648b-4665-ba2b-2189b147d454 req-120aa3af-2636-4fc3-a264-5aa49e5c62a6 service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:40:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-60e00445-648b-4665-ba2b-2189b147d454 req-120aa3af-2636-4fc3-a264-5aa49e5c62a6 service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:40:50 user nova-compute[75113]: DEBUG nova.compute.manager [req-60e00445-648b-4665-ba2b-2189b147d454 req-120aa3af-2636-4fc3-a264-5aa49e5c62a6 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] No waiting events found dispatching network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:40:50 user nova-compute[75113]: WARNING nova.compute.manager [req-60e00445-648b-4665-ba2b-2189b147d454 req-120aa3af-2636-4fc3-a264-5aa49e5c62a6 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received unexpected event network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 for instance with vm_state building and task_state spawning.
Oct 26 17:40:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:50 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-17eb1bfe-3c10-4598-8ed5-cc6b6147655a req-59a7e73e-44d3-41ab-9885-b9588d4541eb service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received event network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:40:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-17eb1bfe-3c10-4598-8ed5-cc6b6147655a req-59a7e73e-44d3-41ab-9885-b9588d4541eb service nova] Acquiring lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:40:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-17eb1bfe-3c10-4598-8ed5-cc6b6147655a req-59a7e73e-44d3-41ab-9885-b9588d4541eb service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:40:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-17eb1bfe-3c10-4598-8ed5-cc6b6147655a req-59a7e73e-44d3-41ab-9885-b9588d4541eb service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:40:52 user nova-compute[75113]: DEBUG nova.compute.manager [req-17eb1bfe-3c10-4598-8ed5-cc6b6147655a req-59a7e73e-44d3-41ab-9885-b9588d4541eb service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] No waiting events found dispatching network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:40:52 user nova-compute[75113]: WARNING nova.compute.manager [req-17eb1bfe-3c10-4598-8ed5-cc6b6147655a req-59a7e73e-44d3-41ab-9885-b9588d4541eb service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received unexpected event network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 for instance with vm_state building and task_state spawning.
Oct 26 17:40:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:40:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:40:52 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Instance spawned successfully.
Oct 26 17:40:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:40:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:40:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:40:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:40:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:40:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:40:52 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:40:52 user nova-compute[75113]: INFO nova.compute.manager [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Took 5.21 seconds to spawn the instance on the hypervisor.
Oct 26 17:40:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:40:52 user nova-compute[75113]: INFO nova.compute.manager [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Took 24.04 seconds to build instance.
Oct 26 17:40:52 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49f38f4b-b9a8-43a6-b0ec-b4c9c941a2fe tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.161s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:40:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:40:56 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:40:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:01 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:01 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 17:41:01 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:41:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:09 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:17 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:17 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 17:41:17 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] There are 0 instances to clean {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 17:41:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:26 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:41:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:41:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:41:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:41:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:37 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:38 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:41:39 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:41:41 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:41:41 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:41:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=25.007850646972656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance dfed668c-07ef-440b-a4e1-5b80d625cec1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing inventories for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating ProviderTree inventory for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating inventory in ProviderTree for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing aggregate associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, aggregates: None {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 17:41:41 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing trait associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 17:41:42 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:41:42 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:41:42 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:41:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-dfed668c-07ef-440b-a4e1-5b80d625cec1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-dfed668c-07ef-440b-a4e1-5b80d625cec1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid dfed668c-07ef-440b-a4e1-5b80d625cec1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Updating instance_info_cache with network_info: [{"id": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "address": "fa:16:3e:c5:43:60", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e6efe2-92", "ovs_interfaceid": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-dfed668c-07ef-440b-a4e1-5b80d625cec1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:41:43 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:46 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:46 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:41:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:41:50 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:50 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Triggering sync for uuid dfed668c-07ef-440b-a4e1-5b80d625cec1 {{(pid=75113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 17:41:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "dfed668c-07ef-440b-a4e1-5b80d625cec1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:41:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:41:50 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:41:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:41:57 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:41:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:42:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:42:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-bd192c0c-7f4d-42be-95a5-86c5a1426038 req-bab73796-134c-4c58-9e17-15f9893cdd8a service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received event network-changed-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:42:21 user nova-compute[75113]: DEBUG nova.compute.manager [req-bd192c0c-7f4d-42be-95a5-86c5a1426038 req-bab73796-134c-4c58-9e17-15f9893cdd8a service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Refreshing instance network info cache due to event network-changed-70e6efe2-921a-4ebd-9d82-bb2fc4b96849. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:42:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-bd192c0c-7f4d-42be-95a5-86c5a1426038 req-bab73796-134c-4c58-9e17-15f9893cdd8a service nova] Acquiring lock "refresh_cache-dfed668c-07ef-440b-a4e1-5b80d625cec1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:42:21 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-bd192c0c-7f4d-42be-95a5-86c5a1426038 req-bab73796-134c-4c58-9e17-15f9893cdd8a service nova] Acquired lock "refresh_cache-dfed668c-07ef-440b-a4e1-5b80d625cec1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:42:21 user nova-compute[75113]: DEBUG nova.network.neutron [req-bd192c0c-7f4d-42be-95a5-86c5a1426038 req-bab73796-134c-4c58-9e17-15f9893cdd8a service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Refreshing network info cache for port 70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG nova.network.neutron [req-bd192c0c-7f4d-42be-95a5-86c5a1426038 req-bab73796-134c-4c58-9e17-15f9893cdd8a service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Updated VIF entry in instance network info cache for port 70e6efe2-921a-4ebd-9d82-bb2fc4b96849. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG nova.network.neutron [req-bd192c0c-7f4d-42be-95a5-86c5a1426038 req-bab73796-134c-4c58-9e17-15f9893cdd8a service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Updating instance_info_cache with network_info: [{"id": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "address": "fa:16:3e:c5:43:60", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e6efe2-92", "ovs_interfaceid": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-bd192c0c-7f4d-42be-95a5-86c5a1426038 req-bab73796-134c-4c58-9e17-15f9893cdd8a service nova] Releasing lock "refresh_cache-dfed668c-07ef-440b-a4e1-5b80d625cec1" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "dfed668c-07ef-440b-a4e1-5b80d625cec1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:42:22 user nova-compute[75113]: INFO nova.compute.manager [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Terminating instance
Oct 26 17:42:22 user nova-compute[75113]: DEBUG nova.compute.manager [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG nova.compute.manager [req-15e4ba5e-1475-441c-a8c6-f4dcf436b501 req-c5cd1b6a-7036-427e-adc6-a786be48aceb service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received event network-vif-unplugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-15e4ba5e-1475-441c-a8c6-f4dcf436b501 req-c5cd1b6a-7036-427e-adc6-a786be48aceb service nova] Acquiring lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-15e4ba5e-1475-441c-a8c6-f4dcf436b501 req-c5cd1b6a-7036-427e-adc6-a786be48aceb service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-15e4ba5e-1475-441c-a8c6-f4dcf436b501 req-c5cd1b6a-7036-427e-adc6-a786be48aceb service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG nova.compute.manager [req-15e4ba5e-1475-441c-a8c6-f4dcf436b501 req-c5cd1b6a-7036-427e-adc6-a786be48aceb service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] No waiting events found dispatching network-vif-unplugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG nova.compute.manager [req-15e4ba5e-1475-441c-a8c6-f4dcf436b501 req-c5cd1b6a-7036-427e-adc6-a786be48aceb service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received event network-vif-unplugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:22 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Instance destroyed successfully.
Oct 26 17:42:22 user nova-compute[75113]: DEBUG nova.objects.instance [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lazy-loading 'resources' on Instance uuid dfed668c-07ef-440b-a4e1-5b80d625cec1 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-774329911',display_name='tempest-TestVolumeBootPattern-server-774329911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-774329911',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwKQNJGuV43brbtlRGdAvMJhBjPf39B8oXLeM8Po7JgfKYhm2iVYdrl5rrnrab3QGLKiS6e05OdA99Yvl7m6ZHVEnXLb3uZjQBChYFsMikeuB7XgifIq52X1RFutnz4/A==',key_name='tempest-TestVolumeBootPattern-2003924975',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-z899fauv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:40:53Z,user_data=None,user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=dfed668c-07ef-440b-a4e1-5b80d625cec1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "address": "fa:16:3e:c5:43:60", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e6efe2-92", "ovs_interfaceid": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "address": "fa:16:3e:c5:43:60", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e6efe2-92", "ovs_interfaceid": "70e6efe2-921a-4ebd-9d82-bb2fc4b96849", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:43:60,bridge_name='br-int',has_traffic_filtering=True,id=70e6efe2-921a-4ebd-9d82-bb2fc4b96849,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e6efe2-92') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:42:22 user nova-compute[75113]: DEBUG os_vif [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:43:60,bridge_name='br-int',has_traffic_filtering=True,id=70e6efe2-921a-4ebd-9d82-bb2fc4b96849,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e6efe2-92') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70e6efe2-92, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c009708b-81b8-4c15-bcee-f0339165126f) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:42:23 user nova-compute[75113]: INFO os_vif [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:43:60,bridge_name='br-int',has_traffic_filtering=True,id=70e6efe2-921a-4ebd-9d82-bb2fc4b96849,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e6efe2-92')
Oct 26 17:42:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KaHQEyjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:42:23 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a41557-bae9-4ece-9f91-2fe815eb63ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:42:23 user nova-compute[75113]: No targets found.
Oct 26 17:42:23 user nova-compute[75113]: iSNS:
Oct 26 17:42:23 user nova-compute[75113]: No targets found.
Oct 26 17:42:23 user nova-compute[75113]: STATIC:
Oct 26 17:42:23 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4
Oct 26 17:42:23 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:42:23 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:42:23 user nova-compute[75113]: FIRMWARE:
Oct 26 17:42:23 user nova-compute[75113]: No targets found.
Oct 26 17:42:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:42:23 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:42:23 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f918c748-93f8-4b8d-a987-9ec846a2d996]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5f5655-2021-4b65-91df-f99c491142dd]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:42:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:42:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914681a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee7e5d8-89d5-42e2-b0e0-b0ac572fa02b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96f5dd7-66fc-40f0-a52c-68262a92f5c1]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2839c5-f61f-424c-8ec0-ef614bc7a284]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f68f3f-5635-46d8-ae8e-5c67d7e6c0aa]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bce7e59-6999-4bfd-9385-1a3f38ad9761]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb3cc87-262a-4fd4-9bb2-074e15cb2a76]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260]
Oct 26 17:42:23 user nova-compute[75113]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260] successful.
Oct 26 17:42:23 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d79118-69f0-4e32-a50d-57057f1b75e7]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== disconnect_volume: return (311ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:42:23 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Deleting instance files /opt/stack/data/nova/instances/dfed668c-07ef-440b-a4e1-5b80d625cec1_del
Oct 26 17:42:23 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Deletion of /opt/stack/data/nova/instances/dfed668c-07ef-440b-a4e1-5b80d625cec1_del complete
Oct 26 17:42:23 user nova-compute[75113]: INFO nova.compute.manager [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 26 17:42:23 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:42:24 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Took 0.90 seconds to deallocate network for instance.
Oct 26 17:42:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-1a62fdd7-3f79-4085-9044-89377fe236ea req-cb333e51-9198-4466-a73e-c174344c383f service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received event network-vif-deleted-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received event network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Acquiring lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] No waiting events found dispatching network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:42:24 user nova-compute[75113]: WARNING nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received unexpected event network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 for instance with vm_state active and task_state deleting.
Oct 26 17:42:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received event network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Acquiring lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] No waiting events found dispatching network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:42:24 user nova-compute[75113]: WARNING nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received unexpected event network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 for instance with vm_state active and task_state deleting.
Oct 26 17:42:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received event network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Acquiring lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] No waiting events found dispatching network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:42:24 user nova-compute[75113]: WARNING nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received unexpected event network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 for instance with vm_state active and task_state deleting.
Oct 26 17:42:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received event network-vif-unplugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Acquiring lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] No waiting events found dispatching network-vif-unplugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received event network-vif-unplugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received event network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Acquiring lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:42:24 user nova-compute[75113]: DEBUG nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] No waiting events found dispatching network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:42:24 user nova-compute[75113]: WARNING nova.compute.manager [req-43b8857e-d93e-4ff4-9d6a-419b9eda485f req-9ada07c3-1c49-4c1c-8c03-27b86e935119 service nova] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Received unexpected event network-vif-plugged-70e6efe2-921a-4ebd-9d82-bb2fc4b96849 for instance with vm_state active and task_state deleting.
Oct 26 17:42:25 user nova-compute[75113]: INFO nova.compute.manager [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: dfed668c-07ef-440b-a4e1-5b80d625cec1] Took 0.86 seconds to detach 1 volumes for instance.
Oct 26 17:42:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:42:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:42:25 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:42:25 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:42:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:42:25 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Deleted allocations for instance dfed668c-07ef-440b-a4e1-5b80d625cec1
Oct 26 17:42:25 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-c9823a93-9787-47f2-8643-103cbe1a75df tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "dfed668c-07ef-440b-a4e1-5b80d625cec1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.432s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:42:27 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:42:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:42:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:42:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:42:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:42:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:42:38 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:38 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:42:39 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:42:39 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:42:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:42:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:42:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:42:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:42:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:42:41 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:42:41 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:42:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=9010MB free_disk=24.99808120727539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:42:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:42:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:42:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:42:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:42:41 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:42:41 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:42:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:42:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:42:43 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:42:43 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:42:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:42:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:42:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 17:42:44 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:42:47 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:42:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:42:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:42:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:42:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:42:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:42:48 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:53 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:42:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:42:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:42:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:42:58 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:42:59 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:43:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:43:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:43:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:43:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:43:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:43:03 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:43:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:43:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:43:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:43:08 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:09 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:43:13 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:43:14 user nova-compute[75113]: INFO nova.compute.claims [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Claim successful on node user
Oct 26 17:43:14 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG nova.network.neutron [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:43:14 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:43:14 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG nova.policy [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81bf8ffc2a3746ad9f895d7c2118e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf93275d83e4eeeb9f8d1dc96d6e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:43:14 user nova-compute[75113]: INFO nova.virt.block_device [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Booting with volume 0a07b099-3af9-42e8-8e11-178af239f0b4 at /dev/vda
Oct 26 17:43:14 user nova-compute[75113]: DEBUG os_brick.utils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e97c121-cab7-4aba-b95a-9483faffb0c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:14 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3830c96-451f-43fc-9275-e7b86b377dbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab399732-3a30-49a7-a9cc-c06a16ba730b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1be23b-d5c9-4bf9-8aef-cea8f0f0e299]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:43:15 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:43:15 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d72348-c094-47c2-9fda-b33a4a3c3ae0]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG os_brick.utils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updating existing volume attachment record: e2430c00-012e-4600-b690-4d6bf4b95457 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:43:15 user nova-compute[75113]: DEBUG nova.network.neutron [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Successfully created port: 6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:43:16 user nova-compute[75113]: DEBUG nova.network.neutron [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Successfully updated port: 6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:43:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:43:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquired lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:43:16 user nova-compute[75113]: DEBUG nova.network.neutron [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:43:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-4ec4bdc0-4949-48ca-890a-7d3a3466c9a1 req-f9559ca2-3d9d-4115-b23d-a6c27c2bb0ca service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Received event network-changed-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:43:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-4ec4bdc0-4949-48ca-890a-7d3a3466c9a1 req-f9559ca2-3d9d-4115-b23d-a6c27c2bb0ca service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Refreshing instance network info cache due to event network-changed-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:43:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4ec4bdc0-4949-48ca-890a-7d3a3466c9a1 req-f9559ca2-3d9d-4115-b23d-a6c27c2bb0ca service nova] Acquiring lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:43:16 user nova-compute[75113]: DEBUG nova.network.neutron [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:43:16 user nova-compute[75113]: DEBUG nova.network.neutron [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updating instance_info_cache with network_info: [{"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:43:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Releasing lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:43:16 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Instance network_info: |[{"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:43:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4ec4bdc0-4949-48ca-890a-7d3a3466c9a1 req-f9559ca2-3d9d-4115-b23d-a6c27c2bb0ca service nova] Acquired lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:43:16 user nova-compute[75113]: DEBUG nova.network.neutron [req-4ec4bdc0-4949-48ca-890a-7d3a3466c9a1 req-f9559ca2-3d9d-4115-b23d-a6c27c2bb0ca service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Refreshing network info cache for port 6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:43:17 user nova-compute[75113]: DEBUG nova.network.neutron [req-4ec4bdc0-4949-48ca-890a-7d3a3466c9a1 req-f9559ca2-3d9d-4115-b23d-a6c27c2bb0ca service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updated VIF entry in instance network info cache for port 6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:43:17 user nova-compute[75113]: DEBUG nova.network.neutron [req-4ec4bdc0-4949-48ca-890a-7d3a3466c9a1 req-f9559ca2-3d9d-4115-b23d-a6c27c2bb0ca service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updating instance_info_cache with network_info: [{"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:43:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4ec4bdc0-4949-48ca-890a-7d3a3466c9a1 req-f9559ca2-3d9d-4115-b23d-a6c27c2bb0ca service nova] Releasing lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:43:18 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:43:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:43:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:43:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:43:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:43:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:43:23 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:28 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:43:33 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Creating image(s)
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Ensure instance console log exists: /opt/stack/data/nova/instances/5a9ee196-8fa1-421c-aec6-05a6f80a75e9/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Start _get_guest_xml network_info=[{"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e2430c00-012e-4600-b690-4d6bf4b95457', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KaHQEyjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a9ee196-8fa1-421c-aec6-05a6f80a75e9', 'attached_at': '', 'detached_at': '', 'volume_id': '0a07b099-3af9-42e8-8e11-178af239f0b4', 'serial': '0a07b099-3af9-42e8-8e11-178af239f0b4'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:43:33 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:43:33 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KaHQEyjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:43:33 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:43:33 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:43:33 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e770a7-e4b6-479a-b334-9c61400bdbec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:43:33 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd53a066-0fc5-4503-9e95-f33c5d88ad50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4] added
Oct 26 17:43:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[317b6158-00db-4aba-9ea6-92c43027548a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bb97dd-70db-4b1d-abc9-3d9a2ad23939]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KaHQEyjp {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KaHQEyjp" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc5f645-3dc5-44c9-807c-e539a8f40534]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KaHQEyjp'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c750fbf1-f5cb-4f4f-a8b3-188d3866e12c]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3515aceb-f725-4d53-a099-ebed5a8f247c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:43:33 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 17:43:33 user nova-compute[75113]:  {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:43:33 user nova-compute[75113]: WARNING os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 17:43:33 user nova-compute[75113]: 
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd2eac8-015b-45a6-8d4b-c779952cf232]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260]
Oct 26 17:43:33 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260] successful.
Oct 26 17:43:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1717a8-1d2a-4d38-a48a-6dba79deaf16]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1109bb3a-bd61-4440-b169-27cade41c6e9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:43:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:43:33 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7637f5-308e-4e61-8bea-f3eafcd031fe]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:43:33 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KaHQEyjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23030653631643562', 'path': '/dev/sdb'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030653631643562', 'path': '/dev/sdb'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1090496942',display_name='tempest-TestVolumeBootPattern-server-1090496942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1090496942',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwKQNJGuV43brbtlRGdAvMJhBjPf39B8oXLeM8Po7JgfKYhm2iVYdrl5rrnrab3QGLKiS6e05OdA99Yvl7m6ZHVEnXLb3uZjQBChYFsMikeuB7XgifIq52X1RFutnz4/A==',key_name='tempest-TestVolumeBootPattern-2003924975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-zr5pfrwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:43:15Z,user_data=None,user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=5a9ee196-8fa1-421c-aec6-05a6f80a75e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:43:b1,bridge_name='br-int',has_traffic_filtering=True,id=6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9bf151-7c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG nova.objects.instance [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a9ee196-8fa1-421c-aec6-05a6f80a75e9 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:43:34 user nova-compute[75113]:   <uuid>5a9ee196-8fa1-421c-aec6-05a6f80a75e9</uuid>
Oct 26 17:43:34 user nova-compute[75113]:   <name>instance-00000033</name>
Oct 26 17:43:34 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:43:34 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:43:34 user nova-compute[75113]:   <metadata>
Oct 26 17:43:34 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:43:34 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:43:34 user nova-compute[75113]:       <nova:name>tempest-TestVolumeBootPattern-server-1090496942</nova:name>
Oct 26 17:43:34 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:43:33</nova:creationTime>
Oct 26 17:43:34 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:43:34 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:43:34 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:43:34 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:43:34 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:43:34 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:43:34 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:43:34 user nova-compute[75113]:       <nova:owner>
Oct 26 17:43:34 user nova-compute[75113]:         <nova:user uuid="81bf8ffc2a3746ad9f895d7c2118e33a">tempest-TestVolumeBootPattern-27660292-project-member</nova:user>
Oct 26 17:43:34 user nova-compute[75113]:         <nova:project uuid="9bf93275d83e4eeeb9f8d1dc96d6e7f8">tempest-TestVolumeBootPattern-27660292</nova:project>
Oct 26 17:43:34 user nova-compute[75113]:       </nova:owner>
Oct 26 17:43:34 user nova-compute[75113]:       <nova:ports>
Oct 26 17:43:34 user nova-compute[75113]:         <nova:port uuid="6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6">
Oct 26 17:43:34 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 17:43:34 user nova-compute[75113]:         </nova:port>
Oct 26 17:43:34 user nova-compute[75113]:       </nova:ports>
Oct 26 17:43:34 user nova-compute[75113]:     </nova:instance>
Oct 26 17:43:34 user nova-compute[75113]:   </metadata>
Oct 26 17:43:34 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:43:34 user nova-compute[75113]:     <system>
Oct 26 17:43:34 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:43:34 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:43:34 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:43:34 user nova-compute[75113]:       <entry name="serial">5a9ee196-8fa1-421c-aec6-05a6f80a75e9</entry>
Oct 26 17:43:34 user nova-compute[75113]:       <entry name="uuid">5a9ee196-8fa1-421c-aec6-05a6f80a75e9</entry>
Oct 26 17:43:34 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:43:34 user nova-compute[75113]:     </system>
Oct 26 17:43:34 user nova-compute[75113]:   </sysinfo>
Oct 26 17:43:34 user nova-compute[75113]:   <os>
Oct 26 17:43:34 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:43:34 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:43:34 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:43:34 user nova-compute[75113]:   </os>
Oct 26 17:43:34 user nova-compute[75113]:   <features>
Oct 26 17:43:34 user nova-compute[75113]:     <acpi/>
Oct 26 17:43:34 user nova-compute[75113]:     <apic/>
Oct 26 17:43:34 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:43:34 user nova-compute[75113]:   </features>
Oct 26 17:43:34 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:43:34 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:43:34 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:43:34 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:43:34 user nova-compute[75113]:   </clock>
Oct 26 17:43:34 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:43:34 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:43:34 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:43:34 user nova-compute[75113]:   </cpu>
Oct 26 17:43:34 user nova-compute[75113]:   <devices>
Oct 26 17:43:34 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:43:34 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:43:34 user nova-compute[75113]:       <source dev="/dev/sdb"/>
Oct 26 17:43:34 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:43:34 user nova-compute[75113]:       <serial>0a07b099-3af9-42e8-8e11-178af239f0b4</serial>
Oct 26 17:43:34 user nova-compute[75113]:     </disk>
Oct 26 17:43:34 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:43:34 user nova-compute[75113]:       <mac address="fa:16:3e:77:43:b1"/>
Oct 26 17:43:34 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:43:34 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:43:34 user nova-compute[75113]:       <target dev="tap6b9bf151-7c"/>
Oct 26 17:43:34 user nova-compute[75113]:     </interface>
Oct 26 17:43:34 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:43:34 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/5a9ee196-8fa1-421c-aec6-05a6f80a75e9/console.log" append="off"/>
Oct 26 17:43:34 user nova-compute[75113]:     </serial>
Oct 26 17:43:34 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:43:34 user nova-compute[75113]:     <video>
Oct 26 17:43:34 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:43:34 user nova-compute[75113]:     </video>
Oct 26 17:43:34 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:43:34 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:43:34 user nova-compute[75113]:     </rng>
Oct 26 17:43:34 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:43:34 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:43:34 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:43:34 user nova-compute[75113]:     </memballoon>
Oct 26 17:43:34 user nova-compute[75113]:   </devices>
Oct 26 17:43:34 user nova-compute[75113]: </domain>
Oct 26 17:43:34 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1090496942',display_name='tempest-TestVolumeBootPattern-server-1090496942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1090496942',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwKQNJGuV43brbtlRGdAvMJhBjPf39B8oXLeM8Po7JgfKYhm2iVYdrl5rrnrab3QGLKiS6e05OdA99Yvl7m6ZHVEnXLb3uZjQBChYFsMikeuB7XgifIq52X1RFutnz4/A==',key_name='tempest-TestVolumeBootPattern-2003924975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-zr5pfrwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:43:15Z,user_data=None,user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=5a9ee196-8fa1-421c-aec6-05a6f80a75e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:43:b1,bridge_name='br-int',has_traffic_filtering=True,id=6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9bf151-7c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG os_vif [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:43:b1,bridge_name='br-int',has_traffic_filtering=True,id=6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9bf151-7c') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '878f88e3-0fd8-5e0c-a439-23f723c067c2', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b9bf151-7c, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b9bf151-7c, col_values=(('qos', UUID('d8d107d6-43e5-4573-b236-a068e352b46b')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b9bf151-7c, col_values=(('external_ids', {'iface-id': '6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:43:b1', 'vm-uuid': '5a9ee196-8fa1-421c-aec6-05a6f80a75e9'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:34 user nova-compute[75113]: INFO os_vif [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:43:b1,bridge_name='br-int',has_traffic_filtering=True,id=6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9bf151-7c')
Oct 26 17:43:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:43:34 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] No VIF found with MAC fa:16:3e:77:43:b1, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:43:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-faa339a3-4313-40a2-8e54-a9853a9afe48 req-cb844c1d-0449-4cc5-a103-738fc9b9982f service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Received event network-vif-plugged-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:43:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-faa339a3-4313-40a2-8e54-a9853a9afe48 req-cb844c1d-0449-4cc5-a103-738fc9b9982f service nova] Acquiring lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:43:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-faa339a3-4313-40a2-8e54-a9853a9afe48 req-cb844c1d-0449-4cc5-a103-738fc9b9982f service nova] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:43:36 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-faa339a3-4313-40a2-8e54-a9853a9afe48 req-cb844c1d-0449-4cc5-a103-738fc9b9982f service nova] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:43:36 user nova-compute[75113]: DEBUG nova.compute.manager [req-faa339a3-4313-40a2-8e54-a9853a9afe48 req-cb844c1d-0449-4cc5-a103-738fc9b9982f service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] No waiting events found dispatching network-vif-plugged-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:43:36 user nova-compute[75113]: WARNING nova.compute.manager [req-faa339a3-4313-40a2-8e54-a9853a9afe48 req-cb844c1d-0449-4cc5-a103-738fc9b9982f service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Received unexpected event network-vif-plugged-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 for instance with vm_state building and task_state spawning.
Oct 26 17:43:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:36 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:43:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:43:37 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Instance spawned successfully.
Oct 26 17:43:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:43:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:43:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:43:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:43:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:43:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:43:37 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:43:37 user nova-compute[75113]: INFO nova.compute.manager [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Took 4.87 seconds to spawn the instance on the hypervisor.
Oct 26 17:43:37 user nova-compute[75113]: DEBUG nova.compute.manager [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:43:37 user nova-compute[75113]: INFO nova.compute.manager [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Took 23.48 seconds to build instance.
Oct 26 17:43:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-8e33a253-861b-425d-aa2b-686ab3be812e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.642s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:43:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-cbceae74-af50-40f8-9486-528b0e7abe20 req-4df5acac-c2ed-41d0-ba6e-6b9d9508ad91 service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Received event network-vif-plugged-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:43:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cbceae74-af50-40f8-9486-528b0e7abe20 req-4df5acac-c2ed-41d0-ba6e-6b9d9508ad91 service nova] Acquiring lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:43:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cbceae74-af50-40f8-9486-528b0e7abe20 req-4df5acac-c2ed-41d0-ba6e-6b9d9508ad91 service nova] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:43:38 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-cbceae74-af50-40f8-9486-528b0e7abe20 req-4df5acac-c2ed-41d0-ba6e-6b9d9508ad91 service nova] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:43:38 user nova-compute[75113]: DEBUG nova.compute.manager [req-cbceae74-af50-40f8-9486-528b0e7abe20 req-4df5acac-c2ed-41d0-ba6e-6b9d9508ad91 service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] No waiting events found dispatching network-vif-plugged-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:43:38 user nova-compute[75113]: WARNING nova.compute.manager [req-cbceae74-af50-40f8-9486-528b0e7abe20 req-4df5acac-c2ed-41d0-ba6e-6b9d9508ad91 service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Received unexpected event network-vif-plugged-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 for instance with vm_state active and task_state None.
Oct 26 17:43:38 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:43:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:40 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:43:41 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:43:41 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:43:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=24.995582580566406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5a9ee196-8fa1-421c-aec6-05a6f80a75e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:43:41 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:43:42 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:43:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:43:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:45 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:43:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:43:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:43:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:43:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:43:45 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:43:45 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 5a9ee196-8fa1-421c-aec6-05a6f80a75e9 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:43:45 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updating instance_info_cache with network_info: [{"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:43:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:43:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:43:45 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:43:48 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:43:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:43:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:43:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:44:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:44:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:44:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:44:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:44:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:44:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:44:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:44:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:44:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:44:29 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:44:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:44:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:44:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:44:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:44:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:44:38 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:44:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:44:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:44:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:44:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:44:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:44:41 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:44:41 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:44:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8955MB free_disk=24.994617462158203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5a9ee196-8fa1-421c-aec6-05a6f80a75e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:44:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:44:42 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:44:42 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:44:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:45 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:44:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:44:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:44:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:44:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:44:45 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:44:45 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 5a9ee196-8fa1-421c-aec6-05a6f80a75e9 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:44:45 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updating instance_info_cache with network_info: [{"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:44:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:44:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:44:47 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:44:48 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:44:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:44:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:44:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:44:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:44:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:44:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:44:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:44:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:45:00 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:45:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:45:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-9b494cc7-dde8-4430-8940-e076269e33af req-f6f807f5-03e9-49ce-8d3d-125b3a956191 service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Received event network-changed-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:45:06 user nova-compute[75113]: DEBUG nova.compute.manager [req-9b494cc7-dde8-4430-8940-e076269e33af req-f6f807f5-03e9-49ce-8d3d-125b3a956191 service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Refreshing instance network info cache due to event network-changed-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:45:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9b494cc7-dde8-4430-8940-e076269e33af req-f6f807f5-03e9-49ce-8d3d-125b3a956191 service nova] Acquiring lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:45:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9b494cc7-dde8-4430-8940-e076269e33af req-f6f807f5-03e9-49ce-8d3d-125b3a956191 service nova] Acquired lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:45:06 user nova-compute[75113]: DEBUG nova.network.neutron [req-9b494cc7-dde8-4430-8940-e076269e33af req-f6f807f5-03e9-49ce-8d3d-125b3a956191 service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Refreshing network info cache for port 6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:45:06 user nova-compute[75113]: DEBUG nova.network.neutron [req-9b494cc7-dde8-4430-8940-e076269e33af req-f6f807f5-03e9-49ce-8d3d-125b3a956191 service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updated VIF entry in instance network info cache for port 6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:45:06 user nova-compute[75113]: DEBUG nova.network.neutron [req-9b494cc7-dde8-4430-8940-e076269e33af req-f6f807f5-03e9-49ce-8d3d-125b3a956191 service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updating instance_info_cache with network_info: [{"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:45:06 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-9b494cc7-dde8-4430-8940-e076269e33af req-f6f807f5-03e9-49ce-8d3d-125b3a956191 service nova] Releasing lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:45:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:09 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:45:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:45:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "c3166da7-074c-4299-84ca-365bd31ef620" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:45:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "c3166da7-074c-4299-84ca-365bd31ef620" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:45:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Starting instance... {{(pid=75113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 17:45:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:45:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:45:24 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 17:45:24 user nova-compute[75113]: INFO nova.compute.claims [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Claim successful on node user
Oct 26 17:45:24 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:45:24 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:45:24 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:45:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Start building networks asynchronously for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 17:45:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Allocating IP information in the background. {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 17:45:24 user nova-compute[75113]: DEBUG nova.network.neutron [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] allocate_for_instance() {{(pid=75113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 17:45:24 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 17:45:24 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Start building block device mappings for instance. {{(pid=75113) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 17:45:24 user nova-compute[75113]: DEBUG nova.policy [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81bf8ffc2a3746ad9f895d7c2118e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf93275d83e4eeeb9f8d1dc96d6e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75113) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 17:45:24 user nova-compute[75113]: INFO nova.virt.block_device [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Booting with volume 3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe at /dev/vda
Oct 26 17:45:25 user nova-compute[75113]: DEBUG os_brick.utils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7066fb-8fb9-45f9-b975-e22d48c54507]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:55d5e656cebc\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ac0e54-8096-4d4c-98ba-dd6e03f88665]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5201e1f3-72cc-497a-90c0-a0207cd38ad1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfa00ac-f2b4-4041-8199-c7adbc2d5a49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Running cmd (subprocess): nvme version {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75113) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] nvme not present on system {{(pid=75113) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 17:45:25 user nova-compute[75113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 17:45:25 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0392de-cb52-4b34-b898-445b1ce78b30]: (4, '') {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75113) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.lightos [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] LIGHTOS: no hostnqn found. {{(pid=75113) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG os_brick.utils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:55d5e656cebc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG nova.virt.block_device [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Updating existing volume attachment record: fe941b55-decb-44d4-87ed-612015dfd480 {{(pid=75113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:25 user nova-compute[75113]: DEBUG nova.network.neutron [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Successfully created port: c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 17:45:26 user nova-compute[75113]: DEBUG nova.network.neutron [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Successfully updated port: c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 17:45:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "refresh_cache-c3166da7-074c-4299-84ca-365bd31ef620" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:45:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquired lock "refresh_cache-c3166da7-074c-4299-84ca-365bd31ef620" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:45:26 user nova-compute[75113]: DEBUG nova.network.neutron [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Building network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 17:45:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-661f4803-2322-473e-b557-8360260ee33b req-1b20ab66-5045-4326-84b2-f53f64ce1136 service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Received event network-changed-c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:45:26 user nova-compute[75113]: DEBUG nova.compute.manager [req-661f4803-2322-473e-b557-8360260ee33b req-1b20ab66-5045-4326-84b2-f53f64ce1136 service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Refreshing instance network info cache due to event network-changed-c4d78269-00c9-431b-ab1f-eaa982fa1f77. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:45:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-661f4803-2322-473e-b557-8360260ee33b req-1b20ab66-5045-4326-84b2-f53f64ce1136 service nova] Acquiring lock "refresh_cache-c3166da7-074c-4299-84ca-365bd31ef620" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:45:26 user nova-compute[75113]: DEBUG nova.network.neutron [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Instance cache missing network info. {{(pid=75113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 17:45:26 user nova-compute[75113]: DEBUG nova.network.neutron [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Updating instance_info_cache with network_info: [{"id": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "address": "fa:16:3e:08:2a:2d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d78269-00", "ovs_interfaceid": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:45:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Releasing lock "refresh_cache-c3166da7-074c-4299-84ca-365bd31ef620" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:45:26 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Instance network_info: |[{"id": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "address": "fa:16:3e:08:2a:2d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d78269-00", "ovs_interfaceid": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 17:45:26 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-661f4803-2322-473e-b557-8360260ee33b req-1b20ab66-5045-4326-84b2-f53f64ce1136 service nova] Acquired lock "refresh_cache-c3166da7-074c-4299-84ca-365bd31ef620" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:45:26 user nova-compute[75113]: DEBUG nova.network.neutron [req-661f4803-2322-473e-b557-8360260ee33b req-1b20ab66-5045-4326-84b2-f53f64ce1136 service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Refreshing network info cache for port c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:45:27 user nova-compute[75113]: DEBUG nova.network.neutron [req-661f4803-2322-473e-b557-8360260ee33b req-1b20ab66-5045-4326-84b2-f53f64ce1136 service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Updated VIF entry in instance network info cache for port c4d78269-00c9-431b-ab1f-eaa982fa1f77. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:45:27 user nova-compute[75113]: DEBUG nova.network.neutron [req-661f4803-2322-473e-b557-8360260ee33b req-1b20ab66-5045-4326-84b2-f53f64ce1136 service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Updating instance_info_cache with network_info: [{"id": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "address": "fa:16:3e:08:2a:2d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d78269-00", "ovs_interfaceid": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:45:27 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-661f4803-2322-473e-b557-8360260ee33b req-1b20ab66-5045-4326-84b2-f53f64ce1136 service nova] Releasing lock "refresh_cache-c3166da7-074c-4299-84ca-365bd31ef620" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:45:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:31 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:45:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:45:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:39 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:45:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:45:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:45:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:45:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:45:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:45:41 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:45:41 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:45:41 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:45:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=24.99343490600586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:45:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:45:41 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:45:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5a9ee196-8fa1-421c-aec6-05a6f80a75e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:45:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance c3166da7-074c-4299-84ca-365bd31ef620 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:45:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:45:41 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:45:42 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:45:42 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:45:42 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:45:42 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Start spawning the instance on the hypervisor. {{(pid=75113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Creating instance directory {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 17:45:43 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Creating image(s)
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Did not create local disks {{(pid=75113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Ensure instance console log exists: /opt/stack/data/nova/instances/c3166da7-074c-4299-84ca-365bd31ef620/console.log {{(pid=75113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Start _get_guest_xml network_info=[{"id": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "address": "fa:16:3e:08:2a:2d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d78269-00", "ovs_interfaceid": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fe941b55-decb-44d4-87ed-612015dfd480', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASioatEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3166da7-074c-4299-84ca-365bd31ef620', 'attached_at': '', 'detached_at': '', 'volume_id': '3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe', 'serial': '3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 17:45:43 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:45:43 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU controller missing on host. {{(pid=75113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.host [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU controller found on host. {{(pid=75113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T16:50:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flavor limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Image limits 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flavor pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Image pref 0:0:0 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Got 1 possible topologies {{(pid=75113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.hardware [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Calling os-brick to attach iSCSI Volume {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASioatEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:45:43 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:45:43 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:45:43 user nova-compute[75113]: INFO os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab175751-a7cf-4afc-9e52-c06bc4c6a2b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 17:45:43 user nova-compute[75113]:  {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --interface default --op new {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5aaaed-72e4-4161-a178-688592fb70cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe] added\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe] added
Oct 26 17:45:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[17337636-a912-4d8e-8921-c7daeabe95c2]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43cb1a1-c2a7-406b-a9ca-d391e411b77a]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASioatEh {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASioatEh" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d168c9c-5ecd-487a-bb4a-291456b00b8f]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ASioatEh'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e064e1f2-25e1-451f-a507-0d0ea86353eb]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8fc700-6268-4410-bc1e-1d62985d02e8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:45:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:45:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --login {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1d7d98-13fa-41b7-8b0a-8917056ad198]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe, portal: 172.16.0.220,3260]
Oct 26 17:45:43 user nova-compute[75113]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe, portal: 172.16.0.220,3260] successful.
Oct 26 17:45:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e4ba4b-5869-481f-94fd-0d8621c48d1d]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[812579d8-b94f-4d22-88d5-5c43a8cf3a9e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:45:43 user nova-compute[75113]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe (non-flash)
Oct 26 17:45:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:45:43 user nova-compute[75113]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe (non-flash)
Oct 26 17:45:43 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Connected to 172.16.0.220:3260 {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75113) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75113) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5be2280-b475-49f9-be26-45178b1f729e]: (4, ('- - 0', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:45:43 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75113) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASioatEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75113) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23930306131306262', 'path': '/dev/sdc'} {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930306131306262', 'path': '/dev/sdc'} {{(pid=75113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1786271002',display_name='tempest-TestVolumeBootPattern-server-1786271002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1786271002',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwKQNJGuV43brbtlRGdAvMJhBjPf39B8oXLeM8Po7JgfKYhm2iVYdrl5rrnrab3QGLKiS6e05OdA99Yvl7m6ZHVEnXLb3uZjQBChYFsMikeuB7XgifIq52X1RFutnz4/A==',key_name='tempest-TestVolumeBootPattern-2003924975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-5xvwcl9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:45:25Z,user_data=None,user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=c3166da7-074c-4299-84ca-365bd31ef620,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "address": "fa:16:3e:08:2a:2d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d78269-00", "ovs_interfaceid": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "address": "fa:16:3e:08:2a:2d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d78269-00", "ovs_interfaceid": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=c4d78269-00c9-431b-ab1f-eaa982fa1f77,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d78269-00') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG nova.objects.instance [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lazy-loading 'pci_devices' on Instance uuid c3166da7-074c-4299-84ca-365bd31ef620 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] End _get_guest_xml xml=<domain type="kvm">
Oct 26 17:45:44 user nova-compute[75113]:   <uuid>c3166da7-074c-4299-84ca-365bd31ef620</uuid>
Oct 26 17:45:44 user nova-compute[75113]:   <name>instance-00000034</name>
Oct 26 17:45:44 user nova-compute[75113]:   <memory>524288</memory>
Oct 26 17:45:44 user nova-compute[75113]:   <vcpu>1</vcpu>
Oct 26 17:45:44 user nova-compute[75113]:   <metadata>
Oct 26 17:45:44 user nova-compute[75113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 17:45:44 user nova-compute[75113]:       <nova:package version="0.0.0"/>
Oct 26 17:45:44 user nova-compute[75113]:       <nova:name>tempest-TestVolumeBootPattern-server-1786271002</nova:name>
Oct 26 17:45:44 user nova-compute[75113]:       <nova:creationTime>2023-10-26 17:45:43</nova:creationTime>
Oct 26 17:45:44 user nova-compute[75113]:       <nova:flavor name="m1.tiny">
Oct 26 17:45:44 user nova-compute[75113]:         <nova:memory>512</nova:memory>
Oct 26 17:45:44 user nova-compute[75113]:         <nova:disk>1</nova:disk>
Oct 26 17:45:44 user nova-compute[75113]:         <nova:swap>0</nova:swap>
Oct 26 17:45:44 user nova-compute[75113]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 17:45:44 user nova-compute[75113]:         <nova:vcpus>1</nova:vcpus>
Oct 26 17:45:44 user nova-compute[75113]:       </nova:flavor>
Oct 26 17:45:44 user nova-compute[75113]:       <nova:owner>
Oct 26 17:45:44 user nova-compute[75113]:         <nova:user uuid="81bf8ffc2a3746ad9f895d7c2118e33a">tempest-TestVolumeBootPattern-27660292-project-member</nova:user>
Oct 26 17:45:44 user nova-compute[75113]:         <nova:project uuid="9bf93275d83e4eeeb9f8d1dc96d6e7f8">tempest-TestVolumeBootPattern-27660292</nova:project>
Oct 26 17:45:44 user nova-compute[75113]:       </nova:owner>
Oct 26 17:45:44 user nova-compute[75113]:       <nova:ports>
Oct 26 17:45:44 user nova-compute[75113]:         <nova:port uuid="c4d78269-00c9-431b-ab1f-eaa982fa1f77">
Oct 26 17:45:44 user nova-compute[75113]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 17:45:44 user nova-compute[75113]:         </nova:port>
Oct 26 17:45:44 user nova-compute[75113]:       </nova:ports>
Oct 26 17:45:44 user nova-compute[75113]:     </nova:instance>
Oct 26 17:45:44 user nova-compute[75113]:   </metadata>
Oct 26 17:45:44 user nova-compute[75113]:   <sysinfo type="smbios">
Oct 26 17:45:44 user nova-compute[75113]:     <system>
Oct 26 17:45:44 user nova-compute[75113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 17:45:44 user nova-compute[75113]:       <entry name="product">OpenStack Nova</entry>
Oct 26 17:45:44 user nova-compute[75113]:       <entry name="version">0.0.0</entry>
Oct 26 17:45:44 user nova-compute[75113]:       <entry name="serial">c3166da7-074c-4299-84ca-365bd31ef620</entry>
Oct 26 17:45:44 user nova-compute[75113]:       <entry name="uuid">c3166da7-074c-4299-84ca-365bd31ef620</entry>
Oct 26 17:45:44 user nova-compute[75113]:       <entry name="family">Virtual Machine</entry>
Oct 26 17:45:44 user nova-compute[75113]:     </system>
Oct 26 17:45:44 user nova-compute[75113]:   </sysinfo>
Oct 26 17:45:44 user nova-compute[75113]:   <os>
Oct 26 17:45:44 user nova-compute[75113]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 17:45:44 user nova-compute[75113]:     <boot dev="hd"/>
Oct 26 17:45:44 user nova-compute[75113]:     <smbios mode="sysinfo"/>
Oct 26 17:45:44 user nova-compute[75113]:   </os>
Oct 26 17:45:44 user nova-compute[75113]:   <features>
Oct 26 17:45:44 user nova-compute[75113]:     <acpi/>
Oct 26 17:45:44 user nova-compute[75113]:     <apic/>
Oct 26 17:45:44 user nova-compute[75113]:     <vmcoreinfo/>
Oct 26 17:45:44 user nova-compute[75113]:   </features>
Oct 26 17:45:44 user nova-compute[75113]:   <clock offset="utc">
Oct 26 17:45:44 user nova-compute[75113]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 17:45:44 user nova-compute[75113]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 17:45:44 user nova-compute[75113]:     <timer name="hpet" present="no"/>
Oct 26 17:45:44 user nova-compute[75113]:   </clock>
Oct 26 17:45:44 user nova-compute[75113]:   <cpu mode="custom" match="exact">
Oct 26 17:45:44 user nova-compute[75113]:     <model>Nehalem</model>
Oct 26 17:45:44 user nova-compute[75113]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 17:45:44 user nova-compute[75113]:   </cpu>
Oct 26 17:45:44 user nova-compute[75113]:   <devices>
Oct 26 17:45:44 user nova-compute[75113]:     <disk type="block" device="disk">
Oct 26 17:45:44 user nova-compute[75113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 17:45:44 user nova-compute[75113]:       <source dev="/dev/sdc"/>
Oct 26 17:45:44 user nova-compute[75113]:       <target dev="vda" bus="virtio"/>
Oct 26 17:45:44 user nova-compute[75113]:       <serial>3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe</serial>
Oct 26 17:45:44 user nova-compute[75113]:     </disk>
Oct 26 17:45:44 user nova-compute[75113]:     <interface type="ethernet">
Oct 26 17:45:44 user nova-compute[75113]:       <mac address="fa:16:3e:08:2a:2d"/>
Oct 26 17:45:44 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:45:44 user nova-compute[75113]:       <mtu size="1442"/>
Oct 26 17:45:44 user nova-compute[75113]:       <target dev="tapc4d78269-00"/>
Oct 26 17:45:44 user nova-compute[75113]:     </interface>
Oct 26 17:45:44 user nova-compute[75113]:     <serial type="pty">
Oct 26 17:45:44 user nova-compute[75113]:       <log file="/opt/stack/data/nova/instances/c3166da7-074c-4299-84ca-365bd31ef620/console.log" append="off"/>
Oct 26 17:45:44 user nova-compute[75113]:     </serial>
Oct 26 17:45:44 user nova-compute[75113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 17:45:44 user nova-compute[75113]:     <video>
Oct 26 17:45:44 user nova-compute[75113]:       <model type="virtio"/>
Oct 26 17:45:44 user nova-compute[75113]:     </video>
Oct 26 17:45:44 user nova-compute[75113]:     <rng model="virtio">
Oct 26 17:45:44 user nova-compute[75113]:       <backend model="random">/dev/urandom</backend>
Oct 26 17:45:44 user nova-compute[75113]:     </rng>
Oct 26 17:45:44 user nova-compute[75113]:     <controller type="usb" index="0" model="none"/>
Oct 26 17:45:44 user nova-compute[75113]:     <memballoon model="virtio">
Oct 26 17:45:44 user nova-compute[75113]:       <stats period="10"/>
Oct 26 17:45:44 user nova-compute[75113]:     </memballoon>
Oct 26 17:45:44 user nova-compute[75113]:   </devices>
Oct 26 17:45:44 user nova-compute[75113]: </domain>
Oct 26 17:45:44 user nova-compute[75113]:  {{(pid=75113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1786271002',display_name='tempest-TestVolumeBootPattern-server-1786271002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1786271002',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwKQNJGuV43brbtlRGdAvMJhBjPf39B8oXLeM8Po7JgfKYhm2iVYdrl5rrnrab3QGLKiS6e05OdA99Yvl7m6ZHVEnXLb3uZjQBChYFsMikeuB7XgifIq52X1RFutnz4/A==',key_name='tempest-TestVolumeBootPattern-2003924975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-5xvwcl9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T17:45:25Z,user_data=None,user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=c3166da7-074c-4299-84ca-365bd31ef620,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "address": "fa:16:3e:08:2a:2d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d78269-00", "ovs_interfaceid": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "address": "fa:16:3e:08:2a:2d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d78269-00", "ovs_interfaceid": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=c4d78269-00c9-431b-ab1f-eaa982fa1f77,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d78269-00') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG os_vif [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=c4d78269-00c9-431b-ab1f-eaa982fa1f77,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d78269-00') {{(pid=75113) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2dba127a-57b9-50ba-9d62-12e1425448ab', '_type': 'linux-noop'}}, row=False) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4d78269-00, may_exist=True, interface_attrs={}) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4d78269-00, col_values=(('qos', UUID('ac77b751-27b2-4c7a-8765-8a53ce142903')),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4d78269-00, col_values=(('external_ids', {'iface-id': 'c4d78269-00c9-431b-ab1f-eaa982fa1f77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:2a:2d', 'vm-uuid': 'c3166da7-074c-4299-84ca-365bd31ef620'}),), if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:44 user nova-compute[75113]: INFO os_vif [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=c4d78269-00c9-431b-ab1f-eaa982fa1f77,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d78269-00')
Oct 26 17:45:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 17:45:44 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] No VIF found with MAC fa:16:3e:08:2a:2d, not building metadata {{(pid=75113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Skipping network cache update for instance because it is Building. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 5a9ee196-8fa1-421c-aec6-05a6f80a75e9 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updating instance_info_cache with network_info: [{"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:45 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-f5c0c799-12c5-4dd2-a77d-c47b294ff07d req-f0fb7243-8b09-405c-83ac-5a6647c11320 service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Received event network-vif-plugged-c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:45:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f5c0c799-12c5-4dd2-a77d-c47b294ff07d req-f0fb7243-8b09-405c-83ac-5a6647c11320 service nova] Acquiring lock "c3166da7-074c-4299-84ca-365bd31ef620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:45:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f5c0c799-12c5-4dd2-a77d-c47b294ff07d req-f0fb7243-8b09-405c-83ac-5a6647c11320 service nova] Lock "c3166da7-074c-4299-84ca-365bd31ef620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:45:46 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-f5c0c799-12c5-4dd2-a77d-c47b294ff07d req-f0fb7243-8b09-405c-83ac-5a6647c11320 service nova] Lock "c3166da7-074c-4299-84ca-365bd31ef620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:45:46 user nova-compute[75113]: DEBUG nova.compute.manager [req-f5c0c799-12c5-4dd2-a77d-c47b294ff07d req-f0fb7243-8b09-405c-83ac-5a6647c11320 service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] No waiting events found dispatching network-vif-plugged-c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:45:46 user nova-compute[75113]: WARNING nova.compute.manager [req-f5c0c799-12c5-4dd2-a77d-c47b294ff07d req-f0fb7243-8b09-405c-83ac-5a6647c11320 service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Received unexpected event network-vif-plugged-c4d78269-00c9-431b-ab1f-eaa982fa1f77 for instance with vm_state building and task_state spawning.
Oct 26 17:45:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:46 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Instance event wait completed in 0 seconds for  {{(pid=75113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 17:45:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Guest created on hypervisor {{(pid=75113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 17:45:47 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Instance spawned successfully.
Oct 26 17:45:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 17:45:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Found default for hw_cdrom_bus of ide {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:45:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Found default for hw_disk_bus of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:45:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Found default for hw_input_bus of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:45:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Found default for hw_pointer_model of None {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:45:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Found default for hw_video_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:45:47 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Found default for hw_vif_model of virtio {{(pid=75113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 17:45:48 user nova-compute[75113]: INFO nova.compute.manager [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Took 4.86 seconds to spawn the instance on the hypervisor.
Oct 26 17:45:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Checking state {{(pid=75113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 17:45:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-403effef-ca92-4a5d-9611-e3d061c38a1b req-ec897c3a-eb51-4c16-aaad-d4d74d0df647 service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Received event network-vif-plugged-c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:45:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-403effef-ca92-4a5d-9611-e3d061c38a1b req-ec897c3a-eb51-4c16-aaad-d4d74d0df647 service nova] Acquiring lock "c3166da7-074c-4299-84ca-365bd31ef620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:45:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-403effef-ca92-4a5d-9611-e3d061c38a1b req-ec897c3a-eb51-4c16-aaad-d4d74d0df647 service nova] Lock "c3166da7-074c-4299-84ca-365bd31ef620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:45:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-403effef-ca92-4a5d-9611-e3d061c38a1b req-ec897c3a-eb51-4c16-aaad-d4d74d0df647 service nova] Lock "c3166da7-074c-4299-84ca-365bd31ef620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:45:48 user nova-compute[75113]: DEBUG nova.compute.manager [req-403effef-ca92-4a5d-9611-e3d061c38a1b req-ec897c3a-eb51-4c16-aaad-d4d74d0df647 service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] No waiting events found dispatching network-vif-plugged-c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:45:48 user nova-compute[75113]: WARNING nova.compute.manager [req-403effef-ca92-4a5d-9611-e3d061c38a1b req-ec897c3a-eb51-4c16-aaad-d4d74d0df647 service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Received unexpected event network-vif-plugged-c4d78269-00c9-431b-ab1f-eaa982fa1f77 for instance with vm_state building and task_state spawning.
Oct 26 17:45:48 user nova-compute[75113]: INFO nova.compute.manager [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Took 23.63 seconds to build instance.
Oct 26 17:45:48 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-cab5d59b-8e41-4b60-aa12-e3a1bdc1f140 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "c3166da7-074c-4299-84ca-365bd31ef620" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.888s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:45:48 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:45:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:45:49 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:45:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:45:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:45:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:02 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:46:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:10 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:46:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:15 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:46:15 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 17:46:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:46:28 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:46:28 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Cleaning up deleted instances {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 17:46:28 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] There are 0 instances to clean {{(pid=75113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 17:46:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:46:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:46:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:46:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:46:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:31 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:46:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:46:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:41 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:46:43 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:46:43 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:46:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:46:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:46:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:46:43 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:46:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:46:43 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:46:43 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:46:43 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:46:43 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8907MB free_disk=24.99209213256836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:46:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:46:43 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5a9ee196-8fa1-421c-aec6-05a6f80a75e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance c3166da7-074c-4299-84ca-365bd31ef620 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing inventories for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating ProviderTree inventory for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Updating inventory in ProviderTree for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing aggregate associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, aggregates: None {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Refreshing trait associations for resource provider c33cb59b-e90a-48cc-9491-b92264d66bd5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV {{(pid=75113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:46:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:45 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:46:47 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:46:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:46:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:46:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:46:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquired lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:46:47 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Forcefully refreshing network info cache for instance {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 17:46:47 user nova-compute[75113]: DEBUG nova.objects.instance [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lazy-loading 'info_cache' on Instance uuid 5a9ee196-8fa1-421c-aec6-05a6f80a75e9 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:46:47 user nova-compute[75113]: DEBUG nova.network.neutron [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updating instance_info_cache with network_info: [{"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:46:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Releasing lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:46:47 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updated the network info_cache for instance {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 17:46:48 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:46:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:46:49 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:46:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:46:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:46:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:46:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:46:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:46:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:46:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:03 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:47:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:47:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:47:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:47:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:47:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:47:13 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:47:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:15 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-88286b32-736a-4989-ac4a-48fa30f4446f req-64898c1b-57a4-4971-87ee-b22584a49b4d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Received event network-changed-c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:47:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-88286b32-736a-4989-ac4a-48fa30f4446f req-64898c1b-57a4-4971-87ee-b22584a49b4d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Refreshing instance network info cache due to event network-changed-c4d78269-00c9-431b-ab1f-eaa982fa1f77. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:47:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-88286b32-736a-4989-ac4a-48fa30f4446f req-64898c1b-57a4-4971-87ee-b22584a49b4d service nova] Acquiring lock "refresh_cache-c3166da7-074c-4299-84ca-365bd31ef620" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:47:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-88286b32-736a-4989-ac4a-48fa30f4446f req-64898c1b-57a4-4971-87ee-b22584a49b4d service nova] Acquired lock "refresh_cache-c3166da7-074c-4299-84ca-365bd31ef620" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:47:16 user nova-compute[75113]: DEBUG nova.network.neutron [req-88286b32-736a-4989-ac4a-48fa30f4446f req-64898c1b-57a4-4971-87ee-b22584a49b4d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Refreshing network info cache for port c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:47:16 user nova-compute[75113]: DEBUG nova.network.neutron [req-88286b32-736a-4989-ac4a-48fa30f4446f req-64898c1b-57a4-4971-87ee-b22584a49b4d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Updated VIF entry in instance network info cache for port c4d78269-00c9-431b-ab1f-eaa982fa1f77. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:47:16 user nova-compute[75113]: DEBUG nova.network.neutron [req-88286b32-736a-4989-ac4a-48fa30f4446f req-64898c1b-57a4-4971-87ee-b22584a49b4d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Updating instance_info_cache with network_info: [{"id": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "address": "fa:16:3e:08:2a:2d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d78269-00", "ovs_interfaceid": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:47:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-88286b32-736a-4989-ac4a-48fa30f4446f req-64898c1b-57a4-4971-87ee-b22584a49b4d service nova] Releasing lock "refresh_cache-c3166da7-074c-4299-84ca-365bd31ef620" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:47:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-0a445693-236c-40ca-965d-30a0739d2a53 req-51317f9a-bc2a-4892-83d5-08bfd687480d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Received event network-changed-c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:47:16 user nova-compute[75113]: DEBUG nova.compute.manager [req-0a445693-236c-40ca-965d-30a0739d2a53 req-51317f9a-bc2a-4892-83d5-08bfd687480d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Refreshing instance network info cache due to event network-changed-c4d78269-00c9-431b-ab1f-eaa982fa1f77. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:47:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0a445693-236c-40ca-965d-30a0739d2a53 req-51317f9a-bc2a-4892-83d5-08bfd687480d service nova] Acquiring lock "refresh_cache-c3166da7-074c-4299-84ca-365bd31ef620" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:47:16 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0a445693-236c-40ca-965d-30a0739d2a53 req-51317f9a-bc2a-4892-83d5-08bfd687480d service nova] Acquired lock "refresh_cache-c3166da7-074c-4299-84ca-365bd31ef620" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:47:16 user nova-compute[75113]: DEBUG nova.network.neutron [req-0a445693-236c-40ca-965d-30a0739d2a53 req-51317f9a-bc2a-4892-83d5-08bfd687480d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Refreshing network info cache for port c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "c3166da7-074c-4299-84ca-365bd31ef620" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "c3166da7-074c-4299-84ca-365bd31ef620" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "c3166da7-074c-4299-84ca-365bd31ef620-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "c3166da7-074c-4299-84ca-365bd31ef620-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "c3166da7-074c-4299-84ca-365bd31ef620-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:47:17 user nova-compute[75113]: INFO nova.compute.manager [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Terminating instance
Oct 26 17:47:17 user nova-compute[75113]: DEBUG nova.compute.manager [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG nova.network.neutron [req-0a445693-236c-40ca-965d-30a0739d2a53 req-51317f9a-bc2a-4892-83d5-08bfd687480d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Updated VIF entry in instance network info cache for port c4d78269-00c9-431b-ab1f-eaa982fa1f77. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG nova.network.neutron [req-0a445693-236c-40ca-965d-30a0739d2a53 req-51317f9a-bc2a-4892-83d5-08bfd687480d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Updating instance_info_cache with network_info: [{"id": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "address": "fa:16:3e:08:2a:2d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d78269-00", "ovs_interfaceid": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-0a445693-236c-40ca-965d-30a0739d2a53 req-51317f9a-bc2a-4892-83d5-08bfd687480d service nova] Releasing lock "refresh_cache-c3166da7-074c-4299-84ca-365bd31ef620" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:17 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Instance destroyed successfully.
Oct 26 17:47:17 user nova-compute[75113]: DEBUG nova.objects.instance [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lazy-loading 'resources' on Instance uuid c3166da7-074c-4299-84ca-365bd31ef620 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1786271002',display_name='tempest-TestVolumeBootPattern-server-1786271002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1786271002',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwKQNJGuV43brbtlRGdAvMJhBjPf39B8oXLeM8Po7JgfKYhm2iVYdrl5rrnrab3QGLKiS6e05OdA99Yvl7m6ZHVEnXLb3uZjQBChYFsMikeuB7XgifIq52X1RFutnz4/A==',key_name='tempest-TestVolumeBootPattern-2003924975',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:45:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-5xvwcl9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:45:48Z,user_data=None,user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=c3166da7-074c-4299-84ca-365bd31ef620,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "address": "fa:16:3e:08:2a:2d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d78269-00", "ovs_interfaceid": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "address": "fa:16:3e:08:2a:2d", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d78269-00", "ovs_interfaceid": "c4d78269-00c9-431b-ab1f-eaa982fa1f77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=c4d78269-00c9-431b-ab1f-eaa982fa1f77,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d78269-00') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG os_vif [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=c4d78269-00c9-431b-ab1f-eaa982fa1f77,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d78269-00') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4d78269-00, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac77b751-27b2-4c7a-8765-8a53ce142903) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:47:17 user nova-compute[75113]: INFO os_vif [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=c4d78269-00c9-431b-ab1f-eaa982fa1f77,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d78269-00')
Oct 26 17:47:17 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASioatEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:47:17 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:47:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2343e4a2-7074-43c7-ba6a-a1d7ceb1632c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:47:17 user nova-compute[75113]: No targets found.
Oct 26 17:47:17 user nova-compute[75113]: iSNS:
Oct 26 17:47:17 user nova-compute[75113]: No targets found.
Oct 26 17:47:17 user nova-compute[75113]: STATIC:
Oct 26 17:47:17 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe
Oct 26 17:47:17 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:47:17 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:47:17 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4
Oct 26 17:47:17 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:47:17 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:47:17 user nova-compute[75113]: FIRMWARE:
Oct 26 17:47:17 user nova-compute[75113]: No targets found.
Oct 26 17:47:17 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:47:17 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:47:17 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87b0d71-14ea-43b8-948e-370d82610b7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d153535-1396-4b02-b09b-d0a7dab72b3e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:47:17 user nova-compute[75113]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe (non-flash)
Oct 26 17:47:17 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:47:17 user nova-compute[75113]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe (non-flash)
Oct 26 17:47:17 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4914145d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe'): ({'sdc'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Removing single pathed devices sdc {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[88353053-ab8f-4b72-8b06-188ef33a3178]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:47:17 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3c5818-d110-47b4-94e5-9037ed99f18b]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flushing IO for device /dev/sdc {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e30d45e-2383-4079-b347-0e9a620578c3]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c3529e-684d-4961-90a5-f84496820381]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] SCSI volumes sdc have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f53c8f2-5ecf-4ac9-a36c-a0f92d53f15b]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3c24f6-911b-43bf-a75d-3a1d4318fff8]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe, portal: 172.16.0.220,3260]
Oct 26 17:47:18 user nova-compute[75113]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe, portal: 172.16.0.220,3260] successful.
Oct 26 17:47:18 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b49ddf2-c37c-42fb-b9c7-673dc9ca1ebe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d76b57-0f8a-4b36-b827-935a7a93ade6]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== disconnect_volume: return (293ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:47:18 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Deleting instance files /opt/stack/data/nova/instances/c3166da7-074c-4299-84ca-365bd31ef620_del
Oct 26 17:47:18 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Deletion of /opt/stack/data/nova/instances/c3166da7-074c-4299-84ca-365bd31ef620_del complete
Oct 26 17:47:18 user nova-compute[75113]: INFO nova.compute.manager [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 26 17:47:18 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: c3166da7-074c-4299-84ca-365bd31ef620] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:47:18 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Took 0.38 seconds to deallocate network for instance.
Oct 26 17:47:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-9924a51d-cf95-4a65-9043-6f544bdd32de req-9b0c4da1-35a7-4432-a7d6-d1b385e2a63f service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Received event network-vif-deleted-c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:47:18 user nova-compute[75113]: INFO nova.compute.manager [req-9924a51d-cf95-4a65-9043-6f544bdd32de req-9b0c4da1-35a7-4432-a7d6-d1b385e2a63f service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Neutron deleted interface c4d78269-00c9-431b-ab1f-eaa982fa1f77; detaching it from the instance and deleting it from the info cache
Oct 26 17:47:18 user nova-compute[75113]: DEBUG nova.network.neutron [req-9924a51d-cf95-4a65-9043-6f544bdd32de req-9b0c4da1-35a7-4432-a7d6-d1b385e2a63f service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:47:18 user nova-compute[75113]: DEBUG nova.compute.manager [req-9924a51d-cf95-4a65-9043-6f544bdd32de req-9b0c4da1-35a7-4432-a7d6-d1b385e2a63f service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Detach interface failed, port_id=c4d78269-00c9-431b-ab1f-eaa982fa1f77, reason: Instance c3166da7-074c-4299-84ca-365bd31ef620 could not be found. {{(pid=75113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-7c9d6107-99ad-4cac-a303-f26f50881814 req-ec604bda-73dc-4c0b-9ffb-444cb855ee7d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Received event network-vif-unplugged-c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7c9d6107-99ad-4cac-a303-f26f50881814 req-ec604bda-73dc-4c0b-9ffb-444cb855ee7d service nova] Acquiring lock "c3166da7-074c-4299-84ca-365bd31ef620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7c9d6107-99ad-4cac-a303-f26f50881814 req-ec604bda-73dc-4c0b-9ffb-444cb855ee7d service nova] Lock "c3166da7-074c-4299-84ca-365bd31ef620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7c9d6107-99ad-4cac-a303-f26f50881814 req-ec604bda-73dc-4c0b-9ffb-444cb855ee7d service nova] Lock "c3166da7-074c-4299-84ca-365bd31ef620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-7c9d6107-99ad-4cac-a303-f26f50881814 req-ec604bda-73dc-4c0b-9ffb-444cb855ee7d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] No waiting events found dispatching network-vif-unplugged-c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-7c9d6107-99ad-4cac-a303-f26f50881814 req-ec604bda-73dc-4c0b-9ffb-444cb855ee7d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Received event network-vif-unplugged-c4d78269-00c9-431b-ab1f-eaa982fa1f77 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-7c9d6107-99ad-4cac-a303-f26f50881814 req-ec604bda-73dc-4c0b-9ffb-444cb855ee7d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Received event network-vif-plugged-c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7c9d6107-99ad-4cac-a303-f26f50881814 req-ec604bda-73dc-4c0b-9ffb-444cb855ee7d service nova] Acquiring lock "c3166da7-074c-4299-84ca-365bd31ef620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7c9d6107-99ad-4cac-a303-f26f50881814 req-ec604bda-73dc-4c0b-9ffb-444cb855ee7d service nova] Lock "c3166da7-074c-4299-84ca-365bd31ef620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-7c9d6107-99ad-4cac-a303-f26f50881814 req-ec604bda-73dc-4c0b-9ffb-444cb855ee7d service nova] Lock "c3166da7-074c-4299-84ca-365bd31ef620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG nova.compute.manager [req-7c9d6107-99ad-4cac-a303-f26f50881814 req-ec604bda-73dc-4c0b-9ffb-444cb855ee7d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] No waiting events found dispatching network-vif-plugged-c4d78269-00c9-431b-ab1f-eaa982fa1f77 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:47:19 user nova-compute[75113]: WARNING nova.compute.manager [req-7c9d6107-99ad-4cac-a303-f26f50881814 req-ec604bda-73dc-4c0b-9ffb-444cb855ee7d service nova] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Received unexpected event network-vif-plugged-c4d78269-00c9-431b-ab1f-eaa982fa1f77 for instance with vm_state active and task_state deleting.
Oct 26 17:47:19 user nova-compute[75113]: INFO nova.compute.manager [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: c3166da7-074c-4299-84ca-365bd31ef620] Took 0.85 seconds to detach 1 volumes for instance.
Oct 26 17:47:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:47:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:47:19 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Deleted allocations for instance c3166da7-074c-4299-84ca-365bd31ef620
Oct 26 17:47:19 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-a592320f-3823-4bd7-9460-37ccab7bc53e tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "c3166da7-074c-4299-84ca-365bd31ef620" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.734s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:47:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:32 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:47:32 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:37 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:42 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:43 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:47:43 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 17:47:45 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:47:45 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:47:45 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=24.99120330810547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Instance 5a9ee196-8fa1-421c-aec6-05a6f80a75e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:47:45 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:47:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:47:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:47:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:47:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:47:47 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:48 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:47:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:47:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 17:47:48 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:47:48 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:47:51 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:47:52 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:47:57 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:02 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:48:07 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:48:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:48:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:48:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:48:12 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:17 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:22 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:27 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:48:28 user nova-compute[75113]: INFO nova.compute.manager [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Terminating instance
Oct 26 17:48:28 user nova-compute[75113]: DEBUG nova.compute.manager [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Start destroying the instance on the hypervisor. {{(pid=75113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-48373668-1ffc-4c08-aed2-45cd99003462 req-f1607d88-8abf-4298-8a90-d1d9a3dd3a7d service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Received event network-changed-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-48373668-1ffc-4c08-aed2-45cd99003462 req-f1607d88-8abf-4298-8a90-d1d9a3dd3a7d service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Refreshing instance network info cache due to event network-changed-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6. {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-48373668-1ffc-4c08-aed2-45cd99003462 req-f1607d88-8abf-4298-8a90-d1d9a3dd3a7d service nova] Acquiring lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-48373668-1ffc-4c08-aed2-45cd99003462 req-f1607d88-8abf-4298-8a90-d1d9a3dd3a7d service nova] Acquired lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG nova.network.neutron [req-48373668-1ffc-4c08-aed2-45cd99003462 req-f1607d88-8abf-4298-8a90-d1d9a3dd3a7d service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Refreshing network info cache for port 6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-4753404f-3010-4bb0-acf5-ed7c69acae9e req-f8c6dd74-af9c-4b83-98e2-39ce13131c7e service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Received event network-vif-unplugged-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4753404f-3010-4bb0-acf5-ed7c69acae9e req-f8c6dd74-af9c-4b83-98e2-39ce13131c7e service nova] Acquiring lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4753404f-3010-4bb0-acf5-ed7c69acae9e req-f8c6dd74-af9c-4b83-98e2-39ce13131c7e service nova] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-4753404f-3010-4bb0-acf5-ed7c69acae9e req-f8c6dd74-af9c-4b83-98e2-39ce13131c7e service nova] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-4753404f-3010-4bb0-acf5-ed7c69acae9e req-f8c6dd74-af9c-4b83-98e2-39ce13131c7e service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] No waiting events found dispatching network-vif-unplugged-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:48:28 user nova-compute[75113]: DEBUG nova.compute.manager [req-4753404f-3010-4bb0-acf5-ed7c69acae9e req-f8c6dd74-af9c-4b83-98e2-39ce13131c7e service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Received event network-vif-unplugged-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 for instance with task_state deleting. {{(pid=75113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG nova.network.neutron [req-48373668-1ffc-4c08-aed2-45cd99003462 req-f1607d88-8abf-4298-8a90-d1d9a3dd3a7d service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updated VIF entry in instance network info cache for port 6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6. {{(pid=75113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG nova.network.neutron [req-48373668-1ffc-4c08-aed2-45cd99003462 req-f1607d88-8abf-4298-8a90-d1d9a3dd3a7d service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updating instance_info_cache with network_info: [{"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-48373668-1ffc-4c08-aed2-45cd99003462 req-f1607d88-8abf-4298-8a90-d1d9a3dd3a7d service nova] Releasing lock "refresh_cache-5a9ee196-8fa1-421c-aec6-05a6f80a75e9" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 17:48:29 user nova-compute[75113]: INFO nova.virt.libvirt.driver [-] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Instance destroyed successfully.
Oct 26 17:48:29 user nova-compute[75113]: DEBUG nova.objects.instance [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lazy-loading 'resources' on Instance uuid 5a9ee196-8fa1-421c-aec6-05a6f80a75e9 {{(pid=75113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.vif [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T17:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1090496942',display_name='tempest-TestVolumeBootPattern-server-1090496942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1090496942',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwKQNJGuV43brbtlRGdAvMJhBjPf39B8oXLeM8Po7JgfKYhm2iVYdrl5rrnrab3QGLKiS6e05OdA99Yvl7m6ZHVEnXLb3uZjQBChYFsMikeuB7XgifIq52X1RFutnz4/A==',key_name='tempest-TestVolumeBootPattern-2003924975',keypairs=<?>,launch_index=0,launched_at=2023-10-26T17:43:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bf93275d83e4eeeb9f8d1dc96d6e7f8',ramdisk_id='',reservation_id='r-zr5pfrwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-27660292',owner_user_name='tempest-TestVolumeBootPattern-27660292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T17:43:38Z,user_data=None,user_id='81bf8ffc2a3746ad9f895d7c2118e33a',uuid=5a9ee196-8fa1-421c-aec6-05a6f80a75e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converting VIF {"id": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "address": "fa:16:3e:77:43:b1", "network": {"id": "592c38d0-9b91-4e2f-89d8-3eada83f9d64", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1200039586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf93275d83e4eeeb9f8d1dc96d6e7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9bf151-7c", "ovs_interfaceid": "6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG nova.network.os_vif_util [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:43:b1,bridge_name='br-int',has_traffic_filtering=True,id=6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9bf151-7c') {{(pid=75113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_vif [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:43:b1,bridge_name='br-int',has_traffic_filtering=True,id=6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9bf151-7c') {{(pid=75113) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b9bf151-7c, bridge=br-int, if_exists=True) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8d107d6-43e5-4573-b236-a068e352b46b) {{(pid=75113) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:48:29 user nova-compute[75113]: INFO os_vif [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:43:b1,bridge_name='br-int',has_traffic_filtering=True,id=6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6,network=Network(592c38d0-9b91-4e2f-89d8-3eada83f9d64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9bf151-7c')
Oct 26 17:48:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] calling os-brick to detach iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f492c2f5e40>, {'target_iqn': 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KaHQEyjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 17:48:29 user nova-compute[75113]: WARNING os_brick.initiator.connectors.base [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[df433abe-1d71-4060-b1b4-47d9ab3995a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 17:48:29 user nova-compute[75113]: No targets found.
Oct 26 17:48:29 user nova-compute[75113]: iSNS:
Oct 26 17:48:29 user nova-compute[75113]: No targets found.
Oct 26 17:48:29 user nova-compute[75113]: STATIC:
Oct 26 17:48:29 user nova-compute[75113]: Target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4
Oct 26 17:48:29 user nova-compute[75113]:         Portal: 172.16.0.220:3260,-1
Oct 26 17:48:29 user nova-compute[75113]:                 Iface Name: default
Oct 26 17:48:29 user nova-compute[75113]: FIRMWARE:
Oct 26 17:48:29 user nova-compute[75113]: No targets found.
Oct 26 17:48:29 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 17:48:29 user nova-compute[75113]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 17:48:29 user nova-compute[75113]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75113) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4', 0)] {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[640eae9b-e26d-450e-83c0-eac7f482b4e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[811f056d-14a4-4420-9d2a-a342e13fd7ff]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:48:29 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 (non-flash)
Oct 26 17:48:29 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f491411a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4'): ({'sdb'}, set())}) {{(pid=75113) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Removing single pathed devices sdb {{(pid=75113) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[10adfc30-6285-4580-a9f6-ad5f2c84c305]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[587929e2-b22f-4357-b4ab-aee95768a3a9]: (4, ('ok\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Flushing IO for device /dev/sdb {{(pid=75113) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd854f86-4772-4e87-aad3-b181aa150567]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75113) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[543be4ff-c4ca-475a-ac3d-7ae314830b6c]: (4, ('1', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.linuxscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] SCSI volumes sdb have been removed. {{(pid=75113) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4')] {{(pid=75113) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b046512-4bc7-482b-a45e-e227175428bf]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --logout {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.037s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cf0fe5-7e33-43bf-aec4-a1e805e8a690]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260]
Oct 26 17:48:29 user nova-compute[75113]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4, portal: 172.16.0.220,3260] successful.
Oct 26 17:48:29 user nova-compute[75113]:  stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op delete {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a07b099-3af9-42e8-8e11-178af239f0b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo.privsep.daemon [-] privsep: reply[54af7a16-98eb-446d-8dbf-f4b29e11de86]: (4, ('', '')) {{(pid=86603) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75113) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.base [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG os_brick.initiator.connectors.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] <== disconnect_volume: return (268ms) None {{(pid=75113) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Disconnected iSCSI Volume {{(pid=75113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 17:48:29 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Deleting instance files /opt/stack/data/nova/instances/5a9ee196-8fa1-421c-aec6-05a6f80a75e9_del
Oct 26 17:48:29 user nova-compute[75113]: INFO nova.virt.libvirt.driver [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Deletion of /opt/stack/data/nova/instances/5a9ee196-8fa1-421c-aec6-05a6f80a75e9_del complete
Oct 26 17:48:29 user nova-compute[75113]: INFO nova.compute.manager [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Took 1.35 seconds to destroy the instance on the hypervisor.
Oct 26 17:48:29 user nova-compute[75113]: DEBUG oslo.service.loopingcall [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75113) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG nova.compute.manager [-] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Deallocating network for instance {{(pid=75113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 17:48:29 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] deallocate_for_instance() {{(pid=75113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 17:48:30 user nova-compute[75113]: DEBUG nova.network.neutron [-] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Updating instance_info_cache with network_info: [] {{(pid=75113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 17:48:30 user nova-compute[75113]: INFO nova.compute.manager [-] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Took 1.08 seconds to deallocate network for instance.
Oct 26 17:48:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-ccfadd84-a21e-4c2c-8293-8cb909b04d0d req-b1e9e4b0-fea7-4e90-b8f9-ba36d71aaede service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Received event network-vif-plugged-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:48:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ccfadd84-a21e-4c2c-8293-8cb909b04d0d req-b1e9e4b0-fea7-4e90-b8f9-ba36d71aaede service nova] Acquiring lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:48:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ccfadd84-a21e-4c2c-8293-8cb909b04d0d req-b1e9e4b0-fea7-4e90-b8f9-ba36d71aaede service nova] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:48:30 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [req-ccfadd84-a21e-4c2c-8293-8cb909b04d0d req-b1e9e4b0-fea7-4e90-b8f9-ba36d71aaede service nova] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:48:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-ccfadd84-a21e-4c2c-8293-8cb909b04d0d req-b1e9e4b0-fea7-4e90-b8f9-ba36d71aaede service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] No waiting events found dispatching network-vif-plugged-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 17:48:30 user nova-compute[75113]: WARNING nova.compute.manager [req-ccfadd84-a21e-4c2c-8293-8cb909b04d0d req-b1e9e4b0-fea7-4e90-b8f9-ba36d71aaede service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Received unexpected event network-vif-plugged-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 for instance with vm_state active and task_state deleting.
Oct 26 17:48:30 user nova-compute[75113]: DEBUG nova.compute.manager [req-ccfadd84-a21e-4c2c-8293-8cb909b04d0d req-b1e9e4b0-fea7-4e90-b8f9-ba36d71aaede service nova] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Received event network-vif-deleted-6b9bf151-7c07-4e46-a4cc-ad8c7e5380d6 {{(pid=75113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 17:48:31 user nova-compute[75113]: INFO nova.compute.manager [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] [instance: 5a9ee196-8fa1-421c-aec6-05a6f80a75e9] Took 0.91 seconds to detach 1 volumes for instance.
Oct 26 17:48:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:48:31 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:48:31 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:48:32 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:48:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:48:32 user nova-compute[75113]: INFO nova.scheduler.client.report [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Deleted allocations for instance 5a9ee196-8fa1-421c-aec6-05a6f80a75e9
Oct 26 17:48:32 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-49529466-9137-400b-bc1b-e28cc54a3d60 tempest-TestVolumeBootPattern-27660292 tempest-TestVolumeBootPattern-27660292-project-member] Lock "5a9ee196-8fa1-421c-aec6-05a6f80a75e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.819s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:48:32 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:48:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:48:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:48:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:48:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:48:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:44 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:48:44 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:48:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:48:46 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:48:47 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:48:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:48:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:48:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:48:47 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:48:47 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:48:47 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:48:47 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=9111MB free_disk=24.990272521972656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:48:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:48:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:48:47 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:48:47 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:48:47 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:48:47 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:48:47 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:48:47 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:48:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:48:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:48:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:48:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:48:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:48:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:50 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:48:50 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:48:50 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:48:50 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 17:48:50 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:48:50 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:48:51 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:48:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:48:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:49:04 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:49:05 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:49:09 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:49:14 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:49:15 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:49:19 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:49:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:49:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:49:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75113) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 17:49:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:49:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75113) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 17:49:24 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:49:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:49:29 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:49:32 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:49:33 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:49:34 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:49:35 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:49:39 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:49:44 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:49:44 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:49:45 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:49:47 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 17:49:49 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:49:49 user nova-compute[75113]: WARNING nova.virt.libvirt.driver [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 17:49:49 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Hypervisor/Node resource view: name=user free_ram=9260MB free_disk=24.976951599121094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG nova.compute.provider_tree [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed in ProviderTree for provider: c33cb59b-e90a-48cc-9491-b92264d66bd5 {{(pid=75113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG nova.scheduler.client.report [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Inventory has not changed for provider c33cb59b-e90a-48cc-9491-b92264d66bd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG nova.compute.resource_tracker [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Compute_service record updated for user:user {{(pid=75113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 17:49:49 user nova-compute[75113]: DEBUG oslo_concurrency.lockutils [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=75113) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 17:49:51 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:49:51 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:49:51 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:49:51 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 17:49:52 user nova-compute[75113]: DEBUG oslo_service.periodic_task [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75113) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 17:49:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Starting heal instance info cache {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 17:49:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Rebuilding the list of instances to heal {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 17:49:52 user nova-compute[75113]: DEBUG nova.compute.manager [None req-2b53f756-a351-4891-a394-1f9daa5445f1 None None] Didn't find any instances for network info cache update. {{(pid=75113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 17:49:54 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 17:49:59 user nova-compute[75113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75113) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}